Millimeter-Wave Radar and Video Fusion Vehicle Detection based on Adaptive Kalman Filtering

Abstract

Abstract Road traffic safety has always been the focus of social concern, and the actual road traffic scenes, where only a single sensor is applied cannot cope with the interference brought by complex external factors, which makes vehicle detection extremely challenging. This paper focuses on a vehicle detection algorithm for the fusion of millimeter-wave radar sensor and monocular camera sensor, including the calibration of millimeter-wave radar and camera, the establishment of a temporal fusion model of the two sensors. Finally, the target information obtained from the two sensors is fused with the data using the adaptive Kalman filter fusion algorithm, which can reduce data ambiguity and increase the reliability and validity of the data. Experiments show that the method can overcome the shortcomings of single sensor in target detection, and the obtained target information is more comprehensive compared with the monocular camera detection results.