An Overview of Recent Advances in Cooperative Optimized Navigation of Multiple Unmanned Surface Vehicles

Weiran Wang; Lirong Kou; Xiaoyang Gao

doi:10.62177/jaet.v3i5.1223

Authors

Weiran Wang Dalian Maritime University
Lirong Kou Dalian Maritime University
Xiaoyang Gao Dalian Maritime University

DOI:

https://doi.org/10.62177/jaet.v3i5.1223

Keywords:

Multi-USVs, Cooperative Optimization, Reinforcement Learning, Anti-disturbance Control, Malicious Cyberattacks

Abstract

With the leapfrog development of marine unmanned system technology, autonomous collaborative operations of multiple Unmanned Surface Vehicles (multi-USVs) have become a key approach to solving complex sea area tasks and improving operational efficiency. Despite extensive application potentials, the cooperative optimized navigation of multiple USVs faces severe challenges. These challenges primarily originate from strong dynamic disturbances and shallow-water effects in complex aquatic environments, as well as nonlinearity and model uncertainty in USV dynamics. Furthermore, multi-objective conflicts in cooperative decision-making, network communication constraints, and security threats from physical failures and malicious cyberattacks further complicate the navigation tasks. Cooperative optimized navigation of multiple USVs has received considerable attention in recent years. This article provides a systematic review of the latest research progress in autonomous cooperative optimization navigation strategies for multiple USVs. First, the three-degree-of-freedom nonlinear dynamic model of USVs and the characterization of environmental disturbances are presented. Next, core distributed optimization techniques, including multi-objective game-theoretic path planning, distributed model predictive control, and reinforcement learning in collaborative decision-making, are briefly discussed. Then, recent results on networked coordination under resource constraints and system security control, such as event-triggered mechanisms, quantization control strategies, robust anti-disturbance control, fault-tolerant control, and active defense strategies against malicious cyberattacks, are reviewed in detail. Finally, several technical bottlenecks are summarized and future trends are suggested to direct future investigations, including multi-degree-of-freedom heterogeneity, all-weather adaptability, and human-machine integration.

Downloads

Download data is not yet available.

References

Liu, Z., Zhang, Y., Yu, X., & Yuan, C. (2016). Unmanned surface vehicles: An overview of developments and challenges. Annual Reviews in Control, 41, 71～93. https://doi.org/10.1016/j.arcontrol.2016.04.018

Do, K. D., Jiang, Z. P., & Pan, J. (2002). Underactuated ship global tracking under relaxed conditions. IEEE Transactions on Automatic Control, 47(9), 1529～1536. https://doi.org/10.1109/TAC.2002.802755

Qu, Y., Zhao, W., Yu, Z., & Xiao, B. (2022). Distributed prescribed performance containment control for unmanned surface vehicles based on disturbance observer. ISA Transactions, 125, 699～706. https://doi.org/10.1016/j.isatra.2021.12.007

Park, J., Kang, M., Lee, Y., Jung, J., Choi, H.-T., & Choi, J. (2023). Multiple Autonomous Surface Vehicles for Autonomous Cooperative Navigation Tasks in a Marine Environment: Development and Preliminary Field Tests. IEEE Access, 11, 36203～36217. https://doi.org/10.1109/ACCESS.2023.3262985

Dong, Z., Liang, X., Liu, D., Yu, C., & Li, W. (2024). Dynamic formation optimisation for energy saving of a fleet of unmanned surface vehicles based on robust optimisation over time strategy. Ocean Engineering, 301, 117382. https://doi.org/10.1016/j.oceaneng.2024.117382

Fossen, T. I. (2011). Handbook of marine craft hydrodynamics and motion control. Wiley.

Bian, X., Fu, M., & Wang, Y. (2011). Chuan bo dong li ding wei [Ship dynamic positioning]. Science Press.

Peng, Z., Wang, J., Wang, D., & Han, Q.-L. (2021). An Overview of Recent Advances in Coordinated Control of Multiple Autonomous Surface Vehicles. IEEE Transactions on Industrial Informatics, 17(2), 732～745. https://doi.org/10.1109/TII.2020.3004343

Zhang, Chengqian, Zhang, Chi, Thies, F., Mao, W., & Ringsberg, J. W. (2025). A voyage planning framework for energy performance analysis of autonomous inland waterway vessels. Energy, 335, 137906. https://doi.org/10.1016/j.energy.2025.137906

Yang, Y., & El Moctar, O. (2024). A mathematical model for ships maneuvering in deep and shallow waters. Ocean Engineering, 295, 116927. https://doi.org/10.1016/j.oceaneng.2024.116927

Liu, Z., Lin, Z., Tao, L., & Lan, J. (2016). Nonlinear Wave–Current Interaction in Water of Finite Depth. Journal of Waterway, Port, Coastal, and Ocean Engineering, 142(6), 04016009. https://doi.org/10.1061/(ASCE)WW.1943-5460.0000345

Xu, F., Gu, N., Peng, Z., Han, B., & Zhang, W. (2026). Collision-Free Reach-Avoid Differential Game of Multiple Underactuated Autonomous Surface Vehicles via Control Barrier Functions. IEEE Transactions on Intelligent Vehicles, 11(1), 42～51. https://doi.org/10.1109/TIV.2025.3578928

Xiao, D., Song, Z., Zhai, M., & Jiang, N. (2025). Distributed multiple unmanned surface vehicles path planning integrated control framework in complex scenarios. Computers and Electrical Engineering, 124, 110430. https://doi.org/10.1016/j.compeleceng.2025.110430

Shi, J., & Ye, M. (2024). Distributed Optimal Formation Control for Unmanned Surface Vessels by a Regularized Game-Based Approach. IEEE/CAA Journal of Automatica Sinica, 11(1), 276～278. https://doi.org/10.1109/JAS.2023.123930

MahmoudZadeh, S., Abbasi, A., Yazdani, A., Wang, H., & Liu, Y. (2022). Uninterrupted path planning system for Multi-USV sampling mission in a cluttered ocean environment. Ocean Engineering, 254, 111328. https://doi.org/10.1016/j.oceaneng.2022.111328

Yin, S., Xu, N., Shi, Z., & Xiang, Z. (2025). Collaborative path planning of multi-unmanned surface vehicles via multi-stage constrained multi-objective optimization. Advanced Engineering Informatics, 65, 103115. https://doi.org/10.1016/j.aei.2025.103115

Wang, H., Fu, Z., Zhou, J., Fu, M., & Ruan, L. (2021). Cooperative collision avoidance for unmanned surface vehicles based on improved genetic algorithm. Ocean Engineering, 222, 108612. https://doi.org/10.1016/j.oceaneng.2021.108612

Wu, Y., Low, K. H., & Lv, C. (2020). Cooperative Path Planning for Heterogeneous Unmanned Vehicles in a Search-and-Track Mission Aiming at an Underwater Target. IEEE Transactions on Vehicular Technology, 69(6), 6782～6787. https://doi.org/10.1109/TVT.2020.2991983

Yao, P., Lou, Y., & Zhang, K. (2023). Multi-USV cooperative path planning by window update based self-organizing map and spectral clustering. Ocean Engineering, 275, 114140. https://doi.org/10.1016/j.oceaneng.2023.114140

Luo, J., & Su, Y. (2024). Path planning for Multi-USV target coverage in complex environments. Ocean Engineering, 312, 119090. https://doi.org/10.1016/j.oceaneng.2024.119090

Wu, F., Su, X., Cheng, T., Xu, H., & Wu, B. (2025). Ship Formation Control Using Nonlinear Model Predictive Control With Safe Speed Constraints and Tidal Elevation Variations. IET Intelligent Transport Systems, 19(1), e70082. https://doi.org/10.1049/itr2.70082

Chen, L., Hopman, H., & Negenborn, R. R. (2018). Distributed model predictive control for vessel train formations of cooperative multi-vessel systems. Transportation Research Part C: Emerging Technologies, 92, 101～118. https://doi.org/10.1016/j.trc.2018.04.013

Zhu, Y., Li, Z., Li, Y., Yuan, C., & Guo, G. (2025). Multi-target tracking and surrounding control for multi-USV system under unknown disturbances based on distributed NMPC. Ocean Engineering, 338, 121972. https://doi.org/10.1016/j.oceaneng.2025.121972

Du, Z., Negenborn, R. R., & Reppa, V. (2023). Distributed Dynamic Coordination Control for Offshore Platform Transportation Under Ocean Environmental Disturbances. IEEE Transactions on Control Systems Technology, 31(5), 2093～2106. https://doi.org/10.1109/TCST.2023.3291557

Du, Z., Negenborn, R. R., & Reppa, V. (2022). COLREGS-Compliant collision avoidance for physically coupled multi-vessel systems with distributed MPC. Ocean Engineering, 260, 111917. https://doi.org/10.1016/j.oceaneng.2022.111917

Tran, H. A., Lauvås, N., Johansen, T. A., & Negenborn, R. R. (2025). Asynchronous Distributed Collision Avoidance With Intention Consensus for Inland Autonomous Ships. IEEE Transactions on Control Systems Technology, 33(6), 2410～2425. https://doi.org/10.1109/TCST.2025.3587842

Wang, C.-C., Wang, Y.-L., Shi, P., & Wang, F. (2024). Scalable-MADDPG-Based Cooperative Target Invasion for a Multi-USV System. IEEE Transactions on Neural Networks and Learning Systems, 35(12), 17867～17877. https://doi.org/10.1109/TNNLS.2023.3309689

Wang, C.-C., Wang, Y.-L., Han, Q.-L., & Xie, W.-B. (2025). Multi-USV Cooperative Formation Control via Deep Reinforcement Learning With Deceleration. IEEE Transactions on Intelligent Vehicles, 10(3), 1909～1918. https://doi.org/10.1109/TIV.2024.3437735

Xiao, R., Liu, C., Chen, H., Xu, L., & Zhang, Y. (2025). Value decomposition reinforcement learning-based formation control for multi-USVs with incomplete information. Ocean Engineering, 342, 123056. https://doi.org/10.1016/j.oceaneng.2025.123056

Xue, S., Zhao, N., Wang, L., Zhang, W., Zhang, J., & Zhu, F. (2025). Multi-agent self-attention reinforcement learning for multi-USV hunting target. Neural Networks, 189, 107574. https://doi.org/10.1016/j.neunet.2025.107574

Qu, X., Jiang, Y., Zhang, R., & Long, F. (2023). A Deep Reinforcement Learning-Based Path-Following Control Scheme for an Uncertain Under-Actuated Autonomous Marine Vehicle. Journal of Marine Science and Engineering, 11(9), 1762. https://doi.org/10.3390/jmse11091762

Wang, N., Gao, Y., Yang, C., & Zhang, X. (2022). Reinforcement learning-based finite-time tracking control of an unknown unmanned surface vehicle with input constraints. Neurocomputing, 484, 26～37. https://doi.org/10.1016/j.neucom.2021.04.133

Peng, Z., Liu, E., Pan, C., Wang, H., Wang, D., & Liu, L. (2023). Model-based deep reinforcement learning for data-driven motion control of an under-actuated unmanned surface vehicle: Path following and trajectory tracking. Journal of the Franklin Institute, 360(6), 4399～4426. https://doi.org/10.1016/j.jfranklin.2022.10.020

Liu, Y., Chen, C., Qu, D., Zhong, Y., Pu, H., Luo, J., Peng, Y., Xie, J., & Zhou, R. (2023). Multi-USV System Antidisturbance Cooperative Searching Based on the Reinforcement Learning Method. IEEE Journal of Oceanic Engineering, 48(4), 1019～1047. https://doi.org/10.1109/JOE.2023.3281630

Chen, L., Wangu, Y., Miao, Z., Jiang, Y., Wang, X., & Dai, S.-L. (2025). Identifier-Critic-Based Adaptive Optimal Control for USVs With Guaranteed Performance. IEEE Transactions on Artificial Intelligence, 1～12. https://doi.org/10.1109/TAI.2025.3640155

Yuan, L.-E., Xiao, Y., Li, T., & Zhou, D. (2024). Output Feedback Adaptive Optimal Control of Multiple Unmanned Marine Vehicles with Unknown External Disturbance. Journal of Marine Science and Engineering, 12(10), 1697. https://doi.org/10.3390/jmse12101697

Xue, S., Zhao, N., Zhang, W., Luo, B., & Liu, D. (2025). A Hybrid Adaptive Dynamic Programming for Optimal Tracking Control of USVs. IEEE Transactions on Neural Networks and Learning Systems, 36(6), 9961～9969. https://doi.org/10.1109/TNNLS.2024.3512539

Li, G., Cao, L., Wang, W., Li, X., & Bai, W. (2025). Neural network-based collision-free optimal formation control for unmanned surface vehicles with the gain iterative disturbance observer. Information Sciences, 719, 122438. https://doi.org/10.1016/j.ins.2025.122438

Lyu, G., Peng, Z., & Wang, J. (2025). Safety-Certified Parallel Model Predictive Control of Autonomous Surface Vehicles via Neurodynamic Optimization. IEEE/CAA Journal of Automatica Sinica, 12(10), 2056～2066. https://doi.org/10.1109/JAS.2024.124980

Qin, J., & Du, J. (2023). Minimum-learning-parameter-based adaptive finite-time trajectory tracking event-triggered control for underactuated surface vessels with parametric uncertainties. Ocean Engineering, 271, 113634. https://doi.org/10.1016/j.oceaneng.2023.113634

Chu, S., & Li, N. (2024). Distributed Composite Learning Adaptive Fault-Tolerant Control for Multiple Marine Vehicles With Event-Triggered Communication. IEEE Transactions on Intelligent Transportation Systems, 25(6), 5664～5673. https://doi.org/10.1109/TITS.2023.3340746

Wu, W., & Tong, S. (2024). Collision-Free Finite-Time Adaptive Fuzzy Output-Feedback Formation Control for Unmanned Surface Vehicle Systems. IEEE Transactions on Intelligent Vehicles, 9(1), 1094～1103. https://doi.org/10.1109/TIV.2023.3335467

Hu, X., Zhu, G., Ma, Y., Li, Z., Malekian, R., & Sotelo, M. Á. (2023). Dynamic Event-Triggered Adaptive Formation With Disturbance Rejection for Marine Vehicles Under Unknown Model Dynamics. IEEE Transactions on Vehicular Technology, 72(5), 5664～5676. https://doi.org/10.1109/TVT.2022.3231585

Ning, J., Ma, Y., & Chen, C. L. P. (2025). Event-Triggered-Based Distributed Formation Cooperative Tracking Control of Under-Actuated Unmanned Surface Vehicles With Input and State Quantization. IEEE Transactions on Intelligent Transportation Systems, 26(5), 7081～7097. https://doi.org/10.1109/TITS.2024.3524442

Bo, P., Li, S., Tu, W., Guo, Q., & Luo, J. (2025). Event-Based H∞ Filtering for Networked Mass-Switching AMVs: An Augmented Lyapunov Functional Approach. IEEE Internet of Things Journal, 12(24), 53055～53069. https://doi.org/10.1109/JIOT.2025.3615154

Ning, J., Wang, Y., Liu, L., & Li, T. (2025). Quantized state feedback adaptive trajectory tracking control of Unmanned Surface Vehicle with state and input quantization. Journal of the Franklin Institute, 362(12), 107654. https://doi.org/10.1016/j.jfranklin.2025.107654

Xu, Q., Feng, L., & Yao, L. (2024). Cooperative Adaptive Tracking Control Based on Quantized States for Multiple Surface Vessels. IEEE Access, 12, 5117～5131. https://doi.org/10.1109/ACCESS.2024.3350189

Wang, W., Wang, Y., & Li, T. (2024). Distributed Formation Maneuvering Quantized Control of Under-Actuated Unmanned Surface Vehicles with Collision and Velocity Constraints. Journal of Marine Science and Engineering, 12(5), 848. https://doi.org/10.3390/jmse12050848

Park, B. S., & Yoo, S. J. (2022). Quantized-communication-based neural network control for formation tracking of networked multiple unmanned surface vehicles without velocity information. Engineering Applications of Artificial Intelligence, 114, 105160. https://doi.org/10.1016/j.engappai.2022.105160

Gu, N., Wang, D., Peng, Z., Wang, J., & Han, Q.-L. (2022). Disturbance observers and extended state observers for marine vehicles: A survey. Control Engineering Practice, 123, 105158. https://doi.org/10.1016/j.conengprac.2022.105158

Fu, M., & Yu, L. (2018). Finite-time extended state observer-based distributed formation control for marine surface vehicles with input saturation and disturbances. Ocean Engineering, 159, 219～227. https://doi.org/10.1016/j.oceaneng.2018.04.016

Wu, T., Liu, Z., Shi, G., & Yu, S. (2023). Robust adaptive output feedback for the formation control of heterogeneous ships based on a nonlinear extended state observer. Ocean Engineering, 289, 116235. https://doi.org/10.1016/j.oceaneng.2023.116235

Ma, Y., Ning, J., Li, T., & Liu, L. (2024). Distributed extended state observer based formation tracking control of under-actuated unmanned surface vehicles with input and state quantization. Ocean Engineering, 311, 118872. https://doi.org/10.1016/j.oceaneng.2024.118872

Luo, Q., Wang, H., Li, N., & Zheng, W. (2024). Multi-unmanned surface vehicle model-free sliding mode predictive adaptive formation control and obstacle avoidance in complex marine environment via model-free extended state observer. Ocean Engineering, 293, 116773. https://doi.org/10.1016/j.oceaneng.2024.116773

Liu, Z., Gong, Q., Hu, X., Zhu, G., Guo, S., Ma, B., & Li, X. (2025). Practical fixed-time formation control with disturbance rejection for marine vehicles under input saturation. ISA Transactions, 164, 100～115. https://doi.org/10.1016/j.isatra.2025.05.032

Jiang, Y., Wang, F., Yu, H., Guo, C., & Liu, Z. (2023). Adaptive prescribed-time containment control for multiple unmanned surface vehicles with uncertain dynamics and actuator dead-zones. Ocean Engineering, 289, 116269. https://doi.org/10.1016/j.oceaneng.2023.116269

Xia, G., Sun, C., Zhao, B., Sun, X., & Xia, X. (2022). Robust cooperative trajectory tracking control for an unactuated floating object with multiple vessels system. ISA Transactions, 123, 263～271. https://doi.org/10.1016/j.isatra.2021.05.043

Jia, Z., Lu, H., Chen, H., & Zhang, W. (2024). Robust Distributed Cooperative Rendezvous Control for Heterogeneous Marine Vehicles Using Model Predictive Control.

Li, J., Zhang, G., Zhang, W., & Zhang, X. (2024). Robust control for cooperative path following of marine surface-air vehicles with a constrained inter-vehicles communication. Ocean Engineering, 308, 118240. https://doi.org/10.1016/j.oceaneng.2024.118240

Liu, C., Chen, H., Jiang, B., Zhang, Y., & Xie, S. (2025). Adaptive Reconfigurable Fault-Tolerant Control of Multi-USVs With Actuator Magnitude and Rate Faults. IEEE Transactions on Industrial Electronics, 72(8), 8512～8521. https://doi.org/10.1109/TIE.2025.3528508

Wang, Y., & Liu, C. (2023). Distributed finite-time adaptive fault-tolerant formation–containment control for USVs with dynamic event-triggered mechanism. Ocean Engineering, 280, 114524. https://doi.org/10.1016/j.oceaneng.2023.114524

Li, K., Feng, K., & Li, Y. (2024). Fuzzy Adaptive Fault-Tolerant Formation Control for USVs With Intermittent Actuator Faults. IEEE Transactions on Intelligent Vehicles, 9(3), 4445～4455. https://doi.org/10.1109/TIV.2024.3358351

Wu, C., Zhu, G., & Lu, J. (2023). Indirect adaptive neural tracking control of USVs under injection and deception attacks. Ocean Engineering, 270, 113641. https://doi.org/10.1016/j.oceaneng.2023.113641

Jiang, Y., Wang, L., Sun, J., & Yu, H. (2024). Attack-resistant distributed formation control for multiple unmanned surface vessels subject to output constraints. Ocean Engineering, 314, 119712. https://doi.org/10.1016/j.oceaneng.2024.119712

Han, S., Zhu, H., Zhong, Q., Shi, K., & Kwon, O.-M. (2024). Secure Sampled-Data Consensus of Multi-Agent Systems Under Asynchronous Deception Attacks With Application to Unmanned Surface Vehicles. IEEE Transactions on Intelligent Transportation Systems, 25(6), 5462～5473. https://doi.org/10.1109/TITS.2023.3330995

Sun, H., Liu, X., & Hou, L. (2025). Event-triggered observer-based dynamic positioning control of unmanned marine vehicle systems under deception attack. Journal of the Franklin Institute, 362(15), 108002. https://doi.org/10.1016/j.jfranklin.2025.108002

Wang, Q., Liu, C., Lan, J., Ren, X., Meng, Y., & Wang, X. (2024). Distributed Secure Surrounding Control for Multiple USVs Against Deception Attacks: A Stackelberg Game Approach With Reinforcement Learning. IEEE Transactions on Intelligent Vehicles, 9(11), 7003～7015. https://doi.org/10.1109/TIV.2024.3392423

Zhong, Q., Han, S., Shi, K., Cai, X., Kwon, O.-M., & Zhong, S. (2022). Secure consensus switching control for multiagent system under abnormal deception attacks and its application to unmanned surface vehicle clusters. Expert Systems with Applications, 205, 117702. https://doi.org/10.1016/j.eswa.2022.117702

Ma, Y., Qi, X., Li, Z., Hu, S., & Sotelo, M. Á. (2024). Resilient Control for Networked Unmanned Surface Vehicles With Dynamic Event-Triggered Mechanism Under Aperiodic DoS Attacks. IEEE Transactions on Vehicular Technology, 73(4), 5824～5833. https://doi.org/10.1109/TVT.2023.3334694

Li, X., Shi, P., & Zhang, W. (2023). Adaptive event-triggered based fault detection filtering for unmanned surface vehicles under DoS attacks. Journal of the Franklin Institute, 360(17), 13051～13079. https://doi.org/10.1016/j.jfranklin.2023.09.047

Zhang, D., Liu, K., Yang, Y., & Li, T. (2025). Dynamic Event-Based Affine Formation Maneuver Control for Multi-ASV Systems Under DoS Attacks. IEEE Transactions on Vehicular Technology, 1～12. https://doi.org/10.1109/TVT.2025.3616498

Zhang, J., Liu, K., Yang, Y., Li, T., & Jia, Z. (2025). Event-based multi-target enclosing control for multi-ASV systems under DoS attacks. Ocean Engineering, 338, 121989. https://doi.org/10.1016/j.oceaneng.2025.121989

Wu, X., Zong, G., Wang, H., Niu, B., & Zhao, X. (2025). Collision-Free Distributed Adaptive Resilient Formation Control for Underactuated USVs Subject to Intermittent Actuator Faults and Denial-of-Service Attacks. IEEE Transactions on Vehicular Technology, 74(9), 13606～13617. https://doi.org/10.1109/TVT.2025.3565820

Feng, N., Wu, D., Yu, H., You, Z., & Tu, W. (2025). Disturbance rejection event-triggered robust nonlinear model predictive control for underactuated unmanned surface vehicle against DoS attacks without velocity measurements. ISA Transactions, 167, 194～205. https://doi.org/10.1016/j.isatra.2025.08.031