Affiliation:
1. Beijing Key Lab of Urban Intelligent Traffic Control Technology, North China University of Technology, Beijing 100144, China
Abstract
As urban areas continue to expand, traffic congestion has emerged as a significant challenge impacting urban governance and economic development. Frequent regional traffic congestion has become a primary factor hindering urban economic growth and social activities, necessitating improved regional traffic management. Addressing regional traffic optimization and control methods based on the characteristics of regional congestion has become a crucial and complex issue in the field of traffic management and control research. This paper focuses on the macroscopic fundamental diagram (MFD) and aims to tackle the control problem without relying on traffic determination information. To address this, we introduce the Q-learning (QL) algorithm in reinforcement learning and the Deep Deterministic Policy Gradient (DDPG) algorithm in deep reinforcement learning. Subsequently, we propose the MFD-QL perimeter control model and the MFD-DDPG perimeter control model. We conduct numerical analysis and simulation experiments to verify the effectiveness of the MFD-QL and MFD-DDPG algorithms. The experimental results show that the algorithms converge rapidly to a stable state and achieve superior control effects in optimizing regional perimeter control.
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference11 articles.
1. The mechanism of a road network;Odfrey;Traffic Eng. Control,1969
2. Feedback gating control considering the congestion at the perimeter intersection;Zhang;Control Theory Appl.,2019
3. Optimal Perimeter Control for Two Urban Regions With Macroscopic Fundamental Diagrams: A Model Predictive Approach;Geroliminis;IEEE Trans. Intell. Transp. Syst.,2013
4. Data fusion algorithm for macroscopic fundamental diagram estimation;Menendez;Transp. Res. Part C,2016
5. Prabhu, S., and George, K. (2014, January 18–20). Performance improvement in MPC with time-varying horizon via switching. Proceedings of the 2014 11th IEEE International Conference on Control & Automation (ICCA), Taichung, Taiwan.