Abstract
Uncertainty of target motion, limited perception ability of onboard cameras, and constrained control have brought new challenges to unmanned aerial vehicle (UAV) dynamic target tracking control. In virtue of the powerful fitting ability and learning ability of the neural network, this paper proposes a new deep reinforcement learning (DRL)-based end-to-end control method for UAV dynamic target tracking. Firstly, a DRL-based framework using onboard camera image is established, which simplifies the traditional modularization paradigm. Secondly, neural network architecture, reward functions, and soft actor-critic (SAC)-based speed command perception algorithm are designed to train the policy network. The output of the policy network is denormalized and directly used as speed control command, which realizes the UAV dynamic target tracking. Finally, the feasibility of the proposed end-to-end control method is demonstrated by numerical simulation. The results show that the proposed DRL-based framework is feasible to simplify the traditional modularization paradigm. The UAV can track the dynamic target with rapidly changing of speed and direction.
Funder
the Fundamental Research Funds for the Central Universities of China
Subject
Molecular Medicine,Biomedical Engineering,Biochemistry,Biomaterials,Bioengineering,Biotechnology
Reference32 articles.
1. Kondoyanni, M., Loukatos, D., and Maraveas, C. (2022). Bio-Inspired Robots and Structures toward Fostering the Modernization of Agriculture. Biomimetics, 7.
2. Autonomous UAV cinematography: A tutorial and a formalized shot-type taxonomy;ACM Comput. Surv.,2019
3. Safety, security, and rescue missions with an unmanned aerial vehicle;J. Intell. Robot. Syst.,2011
4. A compilation of UAV applications for precision agriculture;Comput. Netw.,2020
5. Messina, G., and Modica, G. (2020). Applications of UAV thermal imagery in precision agriculture: State of the art and future research outlook. Remote Sens., 12.
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献