Author:
Zhang Chunyu,Xu Fang,Wu Chengdong,Xu Chenglong
Abstract
Semantic segmentation can address the perceived needs of autonomous driving and micro-robots and is one of the challenging tasks in computer vision. From the application point of view, the difficulty faced by semantic segmentation is how to satisfy inference speed, network parameters, and segmentation accuracy at the same time. This paper proposes a lightweight multi-dimensional dynamic convolutional network (LMDCNet) for real-time semantic segmentation to address this problem. At the core of our architecture is Multidimensional Dynamic Convolution (MDy-Conv), which uses an attention mechanism and factorial convolution to remain efficient while maintaining remarkable accuracy. Specifically, LMDCNet belongs to an asymmetric network architecture. Therefore, we design an encoder module containing MDy-Conv convolution: MS-DAB. The success of this module is attributed to the use of MDy-Conv convolution, which increases the utilization of local and contextual information of features. Furthermore, we design a decoder module containing a feature pyramid and attention: SC-FP, which performs a multi-scale fusion of features accompanied by feature selection. On the Cityscapes and CamVid datasets, LMDCNet achieves accuracies of 73.8 mIoU and 69.6 mIoU at 71.2 FPS and 92.4 FPS, respectively, without pre-training or post-processing. Our designed LMDCNet is trained and inferred only on one 1080Ti GPU. Our experiments show that LMDCNet achieves a good balance between segmentation accuracy and network parameters with only 1.05 M.
Subject
Artificial Intelligence,Biomedical Engineering
Reference34 articles.
1. Segnet: A deep convolutional encoder-decoder architecture for image segmentation.;Badrinarayanan;IEEE Trans. Pattern Anal. Mach. Intell.,2017
2. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs.;Chen;IEEE Trans. Pattern Anal. Mach. Intell.
3. Rethinking atrous convolution for semantic image segmentation.;Chen;arXiv
4. Encoder-decoder with atrous separable convolution for semantic image segmentation;Chen;Proceedings of the European conference on computer vision (ECCV),2018
5. Dynamic convolution: Attention over convolution kernels;Chen;Proceedings of the IEEE/CVF conference on computer vision and pattern recognition,2020
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献