Affiliation:
1. School of Mechanics and Electronics Engineering, Hainan University, Haikou 570228, China
Abstract
The prediction horizon is a key parameter in model predictive control (MPC), which is related to the effectiveness and stability of model predictive control. In vehicle control, the selection of a prediction horizon is influenced by factors such as speed, path curvature, and target point density. To accommodate varying conditions such as road curvature and vehicle speed, we proposed a control strategy using the proximal policy optimization (PPO) algorithm to adjust the prediction horizon, enabling MPC to achieve optimal performance, and called it PPO-MPC. We established a state space related to the path information and vehicle state, regarded the prediction horizon as actions, and designed a reward function to optimize the policy and value function. We conducted simulation verifications at various speeds and compared them with an MPC with fixed prediction horizons. The simulation demonstrates that the PPO-MPC proposed in this article exhibits strong adaptability and trajectory tracking capability.
Funder
Hainan Province Key R&D Plan Project
Hainan Natural Science Foundation
Reference37 articles.
1. Yao, Q., and Tian, Y. (2019). A model predictive controller with longitudinal speed compensation for autonomous vehicle path tracking. Appl. Sci., 9.
2. Wang, H. (2018). Control System Design for Autonomous Vehicle Path Following and Collision Avoidance. [Ph.D. Thesis, The Ohio State University].
3. Bimbraw, K. (2015, January 21–23). Autonomous cars: Past, present and future a review of the developments in the last century, the present scenario and the expected future of autonomous vehicle technology. Proceedings of the 2015 12th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Colmar, France.
4. Bias-Learning-Based Model Predictive Controller Design for Reliable Path Tracking of Autonomous Vehicles Under Model and Environmental Uncertainty;Ren;J. Mech. Des.,2022
5. Review and performance evaluation of path tracking controllers of autonomous vehicles;Rokonuzzaman;IET Intell. Transp. Syst.,2021