Author:
Wang Chuan,Liu Shijie,Wang Xiaoyan,Lan Xiaowei
Abstract
The sensing system consisting of Light Detection and Ranging (LiDAR) and a camera provides complementary information about the surrounding environment. To take full advantage of multi-source data provided by different sensors, an accurate fusion of multi-source sensor information is needed. Time synchronization and space registration are the key technologies that affect the fusion accuracy of multi-source sensors. Due to the difference in data acquisition frequency and deviation in startup time between LiDAR and the camera, asynchronous data acquisition between LiDAR and camera is easy to occur, which has a significant influence on subsequent data fusion. Therefore, a time synchronization method of multi-source sensors based on frequency self-matching is developed in this paper. Without changing the sensor frequency, the sensor data are processed to obtain the same number of data frames and set the same ID number, so that the LiDAR and camera data correspond one by one. Finally, data frames are merged into new data packets to realize time synchronization between LiDAR and camera. Based on time synchronization, to achieve spatial synchronization, a nonlinear optimization algorithm of joint calibration parameters is used, which can effectively reduce the reprojection error in the process of sensor spatial registration. The accuracy of the proposed time synchronization method is 99.86% and the space registration accuracy is 99.79%, which is better than the calibration method of the Matlab calibration toolbox.
Funder
National Natural Science Foundation of China
National Natural Science Foundation of Jiangsu Province
Program of Science and Technology of Suzhou
Key Research and Development Program of Shandong Province
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering
Reference52 articles.
1. Beltrán, J., Guindel, C., and García, F. (2021). Automatic extrinsic calibration method for lidar and camera sensor setups. arXiv.
2. Raj, T., Hashim, F.H., Huddin, A.B., Ibrahim, M.F., and Hussain, A. (2020). A Survey on LiDAR Scanning Mechanisms. Electronics, 9.
3. Wu, J., and Xiong, Z. (2018, January 9–12). A soft time synchronization framework for multi-sensors in autonomous localization and navigation. Proceedings of the IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Auckland, New Zealand.
4. A novel skateboarder-related near-crash identification method with roadside LiDAR data;Wu;Accid. Anal. Prev.,2020
5. Guan, L., Chen, Y., Wang, G., and Lei, X. (2020). Real-Time Vehicle Detection Framework Based on the Fusion of LiDAR and Camera. Electronics, 9.
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献