Affiliation:
1. School of Electronic and Information Engineering Heilongjiang University of Science and Technology Harbin Heilongjiang China
Abstract
AbstractPedestrian trajectory prediction based on vision is a popular task in autopilot system. As pedestrian trajectories always cross each other, pedestrian targets will frequently obscure each other, which makes the collected pedestrian trajectories produce errors. Moreover, the interaction between pedestrians will have an impact on their trajectories in crowded areas, which leads to great challenge in trajectory prediction. In order to solve the above two problems, a pedestrian trajectory prediction method is proposed. Based on the YOLOv7 algorithm, it is connected with the StrongSORT algorithm. Then adding a feature recognition (ReID) module to the model, the problem of target switching and jumping in the process of pedestrian tracking can be solved. The dot product attention mechanism is also integrated into the long short term memory (LSTM) algorithm, the improved LSTM correlate target position and distance information for the pedestrian trajectory prediction. Extensive experiments on three most challenging datasets showed that this method improves the performance and largely reduces the model size.
Funder
Natural Science Foundation of Heilongjiang Province
Publisher
Institution of Engineering and Technology (IET)
Subject
Electrical and Electronic Engineering,Computer Vision and Pattern Recognition,Signal Processing,Software
Reference24 articles.
1. Design, Implementation and Experimental Investigation of a Pedestrian Street Crossing Assistance System Based on Visible Light Communications
2. Pedestrian Street-Cross Action Recognition in Monocular Far Infrared Sequences
3. Viola P. Jones M.:Rapid object detection using a boosted cascade of simple features. In:Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2001 pp.I511–I518.IEEE Piscataway NJ(2001)
4. Dalal N. Triggs B.:Histograms of oriented gradients for human detection. In:Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05) pp.886–893.IEEE Piscataway NJ(2005)