Affiliation:
1. Department of Early Childhood Development and Education, Chaoyang University of Technology, Taichung 413310, Taiwan
2. Department of Computer Science and Information Engineering, National Changhua University of Education, Changhua 50007, Taiwan
3. Department of Mathematics, State University of New York at Geneseo, Geneseo, NY 14454, USA
Abstract
With the development of artificial intelligence technology, deep reinforcement learning (DRL) has become a major approach to the design of intelligent vehicle-to-everything (V2X) routing protocols for vehicular ad hoc networks (VANETs). However, if the V2X routing protocol does not consider both real-time traffic conditions and historical vehicle trajectory information, the source vehicle may not transfer its packet to the correct relay vehicles and, finally, to the destination. Thus, this kind of routing protocol fails to guarantee successful packet delivery. Using the greater network flexibility and scalability of the software-defined network (SDN) architecture, this study designs a two-phase integrated DQN and RF Packet Routing Framework (IDRF) that combines the deep Q-learning network (DQN) and random forest (RF) approaches. First, the IDRF offline phase corrects the vehicle’s historical trajectory information using the vehicle trajectory continuity algorithm and trains the DQN model. Then, the IDRF real-time phase judges whether vehicles can meet each other and makes a real-time routing decision to select the most appropriate relay vehicle after adding real-time vehicles to the VANET. In this way, the IDRF can obtain the packet transfer path with the shortest end-to-end delay. Compared to two DQN-based approaches, i.e., TDRL-RP and VRDRT, and traditional VANET routing algorithms, the IDRF exhibits significant performance improvements for both sparse and congested periods during intensive simulations of the historical GPS trajectories of 10,357 taxis within Beijing city. Performance improvements in the average packet delivery ratio, end-to-end delay, and overhead ratio of the IDRF over TDRL-RP and VRDRT under different numbers of pairs and transmission ranges are at least 3.56%, 12.73%, and 5.14% and 6.06%, 11.84%, and 7.08%, respectively.
Funder
National Science and Technology Council, Taiwan
Reference40 articles.
1. Sharma, S., Agarwal, P., and Mohan, S. (2020, January 3–5). Security challenges and future aspects of fifth generation vehicular ad hoc networking (5G-VANET) in connected vehicles. Proceedings of the 3rd International Conference on Intelligent Sustainable Systems (ICISS), Thoothukudi, India.
2. Towards fast and reliable multihop routing in VANETs;Hamza;IEEE Trans. Mobile Comput.,2020
3. Implementation of a V2P-based VRU warning system with C-V2X technology;Zhang;IEEE Access,2023
4. (2010). IEEE Standard for Information Technology–Local and Metropolitan Area Networks—Specific Requirements—Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications Amendment 6: Wireless Access in Vehicular Environments (Standard No. 802.11p-2010).
5. A comprehensive survey: Benefits, services, recent works, challenges, security, and use cases for SDN-VANET;Zakaria;IEEE Access,2020