Affiliation:
1. Institute for Mechatronics Engineering and Cyber-Physical Systems, Universidad de Málaga, 29071 Málaga, Spain
Abstract
This paper presents the use of deep Reinforcement Learning (RL) for autonomous navigation of an Unmanned Ground Vehicle (UGV) with an onboard three-dimensional (3D) Light Detection and Ranging (LiDAR) sensor in off-road environments. For training, both the robotic simulator Gazebo and the Curriculum Learning paradigm are applied. Furthermore, an Actor–Critic Neural Network (NN) scheme is chosen with a suitable state and a custom reward function. To employ the 3D LiDAR data as part of the input state of the NNs, a virtual two-dimensional (2D) traversability scanner is developed. The resulting Actor NN has been successfully tested in both real and simulated experiments and favorably compared with a previous reactive navigation approach on the same UGV.
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference39 articles.
1. Islam, F., Nabi, M.M., and Ball, J.E. (2022). Off-Road Detection Analysis for Autonomous Ground Vehicles: A Review. Sensors, 22.
2. High-speed navigation of unmanned ground vehicles on uneven terrain using potential fields;Shimoda;Robotica,2007
3. Learning for autonomous navigation;Bagnell;IEEE Robot. Autom. Mag.,2010
4. Sutton, R.S., and Barto, A.G. (2020). Reinforcement Learning: An Introduction, The MIT Press. [2nd ed.].
5. Deep reinforcement learning in computer vision: A comprehensive survey;Le;Artif. Intell. Rev.,2022
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献