Multi-Camera Multi-Vehicle Tracking Guided by Highway Overlapping FoVs
-
Published:2024-05-09
Issue:10
Volume:12
Page:1467
-
ISSN:2227-7390
-
Container-title:Mathematics
-
language:en
-
Short-container-title:Mathematics
Author:
Zhang Hongkai12ORCID, Fang Ruidi1ORCID, Li Suqiang1ORCID, Miao Qiqi1ORCID, Fan Xinggang3ORCID, Hu Jie4ORCID, Chan Sixian56ORCID
Affiliation:
1. School of Electronic and Information Engineering, Anhui Jianzhu University, Hefei 230601, China 2. Key Laboratory of Architectural Cold Climate Energy Management, Ministry of Education, Jilin Jianzhu University, Changchun 130119, China 3. Zhijiang College, Zhejiang University of Technology, Hangzhou 312030, China 4. Key Laboratory of Intelligent Informatics for Safety & Emergency of Zhejiang Province, Wenzhou University, Wenzhou 325035, China 5. College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China 6. Hangzhou Xsuan Technology Co., Ltd., Hangzhou 310000, China
Abstract
Multi-Camera Multi-Vehicle Tracking (MCMVT) is a critical task in Intelligent Transportation Systems (ITS). Differently to in urban environments, challenges in highway tunnel MCMVT arise from the changing target scales as vehicles traverse the narrow tunnels, intense light exposure within the tunnels, high similarity in vehicle appearances, and overlapping camera fields of view, making highway MCMVT more challenging. This paper presents an MCMVT system tailored for highway tunnel roads incorporating road topology structures and the overlapping camera fields of view. The system integrates a Cascade Multi-Level Multi-Target Tracking strategy (CMLM), a trajectory refinement method (HTCF) based on road topology structures, and a spatio-temporal constraint module (HSTC) considering highway entry–exit flow in overlapping fields of view. The CMLM strategy exploits phased vehicle movements within the camera’s fields of view, addressing such challenges as those presented by fast-moving vehicles and appearance variations in long tunnels. The HTCF method filters static traffic signs in the tunnel, compensating for detector imperfections and mitigating the strong lighting effects caused by the tunnel lighting. The HSTC module incorporates spatio-temporal constraints designed for accurate inter-camera trajectory matching within overlapping fields of view. Experiments on the proposed Highway Surveillance Traffic (HST) dataset and CityFlow dataset validate the system’s effectiveness and robustness, achieving an IDF1 score of 81.20% for the HST dataset.
Funder
Zhejiang Provincial Natural Science Foundation of China National Natural Science Foundation of China Construction of Hubei Provincial Key Laboratory for Intelligent Visual Monitoring of Hydropower Projects Hangzhou AI major scientific and technological innovation project Foundation of Key Laboratory of Architectural Cold Climate Energy Management, Ministry of Education
Reference57 articles.
1. Liu, C., Zhang, Y., Luo, H., Tang, J., Chen, W., Xu, X., Wang, F., Li, H., and Shen, Y.D. (2021, January 20–25). City-scale multi-camera vehicle tracking guided by crossroad zones. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA. 2. Yang, X., Ye, J., Lu, J., Gong, C., Jiang, M., Lin, X., Zhang, W., Tan, X., Li, Y., and Ye, X. (2022, January 21–24). Box-grained reranking matching for multi-camera multi-target tracking. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA. 3. Yao, H., Duan, Z., Xie, Z., Chen, J., Wu, X., Xu, D., and Gao, Y. (2022, January 21–24). City-scale multi-camera vehicle tracking based on space-time-appearance features. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA. 4. Huang, H.W., Yang, C.Y., and Hwang, J.N. (2023). Multi-target multi-camera vehicle tracking using transformer-based camera link model and spatial-temporal information. arXiv. 5. Multi-target multi-camera tracking of vehicles using metadata-aided re-id and trajectory-based camera link model;Hsu;IEEE Trans. Image Process.,2021
|
|