Abstract
Cooperative formation control of unmanned ground vehicles (UGVs) has become one of the important research hotspots in the application of UGV and attracted more and more attention in the military and civil fields. Compared with traditional formation control algorithms, reinforcement-learning-based algorithms can provide a new solution with a lower complexity for real-time formation control by equipping UGVs with artificial intelligence. Therefore, in this paper, a distributed deep-reinforcement-learning-based cooperative formation control algorithm is proposed to solve the navigation, maintenance, and obstacle avoidance tasks of UGV formations. More importantly, the hierarchical triangular formation structure and the newly designed Markov decision process for UGV formations of leader and follower attributes make the control strategy learned by the algorithm reusable, so that the formation can arbitrarily increase the number of UGVs and realize a more flexible expansion. The effectiveness and scalability of the algorithm is verified by formation simulation experiments of different scales.
Funder
National Natural Science Foundation of China
Sichuan Science and Technology Program
Reference29 articles.
1. Cooperative multi-agent learning: The state of the art;Panait;Auton. Agents-Multi-Agent Syst.,2005
2. Multi-Agent Systems: A Survey;Dorri;IEEE Access,2018
3. Distributed Estimation and Control for Leader-Following Formations of Nonholonomic Mobile Robots;Miao;IEEE Trans. Autom. Sci. Eng.,2018
4. UVDAR System for Visual Relative Localization With Application to Leader–Follower Formations of Multirotor UAVs;Walter;IEEE Robot. Autom. Lett.,2019
5. Monteiro, S., and Bicho, E. (2002, January 11–15). A dynamical systems approach to behavior-based formation control. Proceedings of the 2002 IEEE International Conference on Robotics and Automation, Washington, DC, USA.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献