Abstract
Learning how to navigate autonomously in an unknown indoor environment without colliding with static and dynamic obstacles is important for mobile robots. The conventional mobile robot navigation system does not have the ability to learn autonomously. Unlike conventional approaches, this paper proposes an end-to-end approach that uses deep reinforcement learning for autonomous mobile robot navigation in an unknown environment. Two types of deep Q-learning agents, such as deep Q-network and double deep Q-network agents are proposed to enable the mobile robot to autonomously learn about collision avoidance and navigation capabilities in an unknown environment. For autonomous mobile robot navigation in an unknown environment, the process of detecting the target object is first carried out using a deep neural network model, and then the process of navigation to the target object is followed using the deep Q-network or double deep Q-network algorithm. The simulation results show that the mobile robot can autonomously navigate, recognize, and reach the target object location in an unknown environment without colliding with static and dynamic obstacles. Similar results are obtained in real-world experiments, but only with static obstacles. The DDQN agent outperforms the DQN agent in reaching the target object location in the test simulation by 5.06%.
Funder
Ministry of Science and Technology (MOST) in Taiwan
Ministry of Education (MOE) in Taiwan
Subject
Process Chemistry and Technology,Chemical Engineering (miscellaneous),Bioengineering
Reference47 articles.
1. Towards Continuous Control for Mobile Robot Navigation: A Reinforcement Learning and Slam Based Approach;Mustafa;Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.,2019
2. Toward Socially Aware Robot Navigation in Dynamic and Crowded Environments: A Proactive Social Motion Model;Truong;IEEE Trans. Autom. Sci. Eng.,2017
3. Aref, M.M., Oftadeh, R., Ghabcheloo, R., and Mattila, J. (2016, January 21–25). Real-time vision-based navigation for nonholonomic mobile robots. Proceedings of the 2016 IEEE International Conference on Automation Science and Engineering (CASE), Fort Worth, TX, USA.
4. Simultaneous localization and mapping: Part I;Bailey;IEEE Robot. Autom. Mag.,2006
5. Behaviour-based control: Examples from navigation, learning, and group behaviour;Mataric;J. Exp. Theor. Artif. Intell.,1997
Cited by
15 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献