Affiliation:
1. College of Information Science and Engineering, Wuhan University of Science and Technology, Wuhan 430081, China
2. Engineering Research Center for Metallurgical Automation and Detecting Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan 430081, China
Abstract
Most of the current visual Simultaneous Localization and Mapping (SLAM) algorithms are designed based on the assumption of a static environment, and their robustness and accuracy in the dynamic environment do not behave well. The reason is that moving objects in the scene will cause the mismatch of features in the pose estimation process, which further affects its positioning and mapping accuracy. In the meantime, the three-dimensional semantic map plays a key role in mobile robot navigation, path planning, and other tasks. In this paper, we present OFM-SLAM: Optical Flow combining MASK-RCNN SLAM, a novel visual SLAM for semantic mapping in dynamic indoor environments. Firstly, we use the Mask-RCNN network to detect potential moving objects which can generate masks of dynamic objects. Secondly, an optical flow method is adopted to detect dynamic feature points. Then, we combine the optical flow method and the MASK-RCNN for full dynamic points’ culling, and the SLAM system is able to track without these dynamic points. Finally, the semantic labels obtained from MASK-RCNN are mapped to the point cloud for generating a three-dimensional semantic map that only contains the static parts of the scenes and their semantic information. We evaluate our system in public TUM datasets. The results of our experiments demonstrate that our system is more effective in dynamic scenarios, and the OFM-SLAM can estimate the camera pose more accurately and acquire a more precise localization in the high dynamic environment.
Funder
Major Project of Hubei Province Technology Innovation
Subject
General Engineering,General Mathematics
Reference23 articles.
1. Semanticfusion: dense 3d semantic mapping with convolutional neural networks;J. McCormac
2. Semantic 3D occupancy mapping through efficient high order CRFs;S. Yang
3. MaskFusion: real-time recognition, tracking and reconstruction of multiple moving objects;M. Runz
4. MID-fusion: octree-based object-level multi-instance dynamic SLAM;B. Xu
5. Simultaneous localization and mapping survey based on filtering techniques;T. S. Ho
Cited by
22 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献