SoC-VRP: A Deep-Reinforcement-Learning-Based Vehicle Route Planning Mechanism for Service-Oriented Cooperative ITS
-
Published:2023-10-10
Issue:20
Volume:12
Page:4191
-
ISSN:2079-9292
-
Container-title:Electronics
-
language:en
-
Short-container-title:Electronics
Author:
Hou Boyuan1ORCID, Zhang Kailong1ORCID, Gong Zu1ORCID, Li Qiugang2, Zhou Junle1, Zhang Jiahao2, de La Fortelle Arnaud3
Affiliation:
1. School of Software, Northwestern Polytechnical University, Xi’an 710129, China 2. School of Computer, Northwestern Polytechnical University, Xi’an 710129, China 3. Centre of Robots, MINES-Paris Sciences et Lettres University, 75006 Paris, France
Abstract
With the rapid development of emerging information technology and its increasing integration with transportation systems, the Intelligent Transportation System (ITS) is entering a new phase, called Cooperative ITS (C-ITS). It offers promising solutions to numerous challenges in traditional transportation systems, among which the Vehicle Routing Problem (VRP) is a significant concern addressed in this work. Considering the varying urgency levels of different vehicles and their different traveling constraints in the Service-oriented Cooperative ITS (SoC-ITS) framework studied in our previous research, the Service-oriented Cooperative Vehicle Routing Problem (SoC-VRP) is firstly analyzed, in which cooperative planning and vehicle urgency degrees are two vital factors. After examining the characteristics of both VRP and SoC-VRP, a Deep Reinforcement Learning (DRL)-based prioritized route planning mechanism is proposed. Specifically, we establish a deep reinforcement learning model with Rainbow DQN and devise a prioritized successive decision-making route planning method for SoC-ITS, where vehicle urgency degrees are mapped to three priorities: High for emergency vehicles, Medium for shuttle buses, and Low for the rest. All proposed models and methods are implemented, trained using various scenarios on typical road networks, and verified with SUMO-based scenes. Experimental results demonstrate the effectiveness of this hybrid prioritized route planning mechanism.
Funder
National Natural Science Foundation of China Fundamental Research Funds for the Central Universities Shaanxi Provincial Science and Technology Project
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering
Reference52 articles.
1. The vehicle routing problem: An overview of exact and approximate algorithms;Laporte;Eur. J. Oper. Res.,1992 2. Toth, P., and Vigo, D. (2002). The Vehicle Routing Problem, SIAM. 3. Solution of a large-scale traveling-salesman problem;Dantzig;J. Oper. Res. Soc. Am.,1954 4. Prieditis, A., and Russell, S. (1995). Machine Learning Proceedings 1995, Morgan Kaufmann. 5. Bello, I., Pham, H., Le, Q.V., Norouzi, M., and Bengio, S. (2016). Neural Combinatorial Optimization with Reinforcement Learning. arXiv.
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|