A pedestrian trajectory prediction method based on improved LSTM network

Abstract

AbstractPedestrian trajectory prediction based on vision is a popular task in autopilot system. As pedestrian trajectories always cross each other, pedestrian targets will frequently obscure each other, which makes the collected pedestrian trajectories produce errors. Moreover, the interaction between pedestrians will have an impact on their trajectories in crowded areas, which leads to great challenge in trajectory prediction. In order to solve the above two problems, a pedestrian trajectory prediction method is proposed. Based on the YOLOv7 algorithm, it is connected with the StrongSORT algorithm. Then adding a feature recognition (ReID) module to the model, the problem of target switching and jumping in the process of pedestrian tracking can be solved. The dot product attention mechanism is also integrated into the long short term memory (LSTM) algorithm, the improved LSTM correlate target position and distance information for the pedestrian trajectory prediction. Extensive experiments on three most challenging datasets showed that this method improves the performance and largely reduces the model size.