Abstract
AbstractWe propose a hierarchical cognitive navigation model (HCNM) to improve the self-learning and self-adaptive ability of mobile robots in unknown and complex environments. The HCNM model adopts the divide and conquers approach by dividing the path planning task into different levels of sub-tasks in complex environments and solves each sub-task in a smaller state subspace to decrease the state space dimensions. The HCNM model imitates animal asymptotic properties through the study of thermodynamic processes and designs a cognitive learning algorithm to achieve online optimum search strategies. We prove that the learning algorithm designed ensures that the cognitive model can converge to the optimal behavior path with probability one. Robot navigation is studied on the basis of the cognitive process. The experimental results show that the HCNM model has strong adaptability in unknown and environment, and the navigation path is clearer and the convergence time is better. Among them, the convergence time of HCNM model is 25 s, which is 86.5% lower than that of HRLM model. The HCNM model studied in this paper adopts a hierarchical structure, which reduces the learning difficulty and accelerates the learning speed in the unknown environment.
Publisher
Cambridge University Press (CUP)
Subject
Computer Science Applications,General Mathematics,Software,Control and Systems Engineering,Control and Optimization,Mechanical Engineering,Modeling and Simulation
Reference35 articles.
1. [18] Touretzky, D. S. , Daw, N. D. and Tira-Thompson, E. J. , “Combining Configural and TD Learning on a Robot,” In: Proceedings of 2th IEEE Conference on Development and Learning, Los Alamitos, CA, USA (2002) pp. 47–52.
2. Semi-Markov decision processes with limiting ratio average rewards;Sagnik;J. Math. Anal. Appl.,2017
3. Neural inverse reinforcement learning in autonomous navigation;Chen;Robot. Auton. Syst.,2016
4. A neural model of hierarchical reinforcement learning
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献