Affiliation:
1. School of Mechanical Electronic & Information Engineering, China University of Mining & Technology, Beijing, Beijing 100 083, China
Abstract
The use of multimodal sensors for lane line segmentation has become a growing trend. To achieve robust multimodal fusion, we introduced a new multimodal fusion method and proved its effectiveness in an improved fusion network. Specifically, a multiscale fusion module is proposed to extract effective features from data of different modalities, and a channel attention module is used to adaptively calculate the contribution of the fused feature channels. We verified the effect of multimodal fusion on the KITTI benchmark dataset and A2D2 dataset and proved the effectiveness of the proposed method on the enhanced KITTI dataset. Our method achieves robust lane line segmentation, which is 4.53% higher than the direct fusion on the precision index, and obtains the highest F2 score of 79.72%. We believe that our method introduces an optimization idea of modal data structure level for multimodal fusion.
Funder
Natural Science Foundation of Shanxi Province
Subject
Multidisciplinary,General Computer Science
Reference36 articles.
1. 3D-LaneNet: End-to-End 3D Multiple Lane Detection
2. Geometric Constrained Joint Lane Segmentation and Lane Boundary Detection
3. Lanenet: real-time lane detection networks for autonomous driving;Ze Wang
4. Weakly Supervised Deep Semantic Segmentation Using CNN and ELM with Semantic Candidate Regions
5. Medical image segmentation algorithm based on optimized convolutional neural network-adaptive dropout depth calculation;An Feng-Ping;Complexity,2020