OMS-SLAM: dynamic scene visual SLAM based on object detection with multiple geometric feature constraints and statistical threshold segmentation

Abstract

Abstract Simultaneous localization and mapping (SLAM) technology is crucial to robot navigation. Despite the good performance of traditional SLAM algorithms in static environments, dynamic objects typically exist in realistic operating environments. These objects can lead to misassociated features, which in turn considerably impact the system’s localization accuracy and robustness. To better address this challenge, we have proposed the OMS-SLAM. In OMS-SLAM, we adopted the YOLOv8 target detection network to extract object information from environment and designed a dynamic probability propagation model that is coupled with target detection and multiple geometric constrains to determine the dynamic objects in the environment. For the identified dynamic objects, we have designed a foreground image segmentation algorithm based on depth image histogram statistics to extract the object contours and eliminate the feature points within these contours. We then use the grid-based motion statistics matching pair as the filtering strategy to enhance the quality of the feature points and use the enhanced feature points for tracking. This combined method can accurately identify dynamic objects and extract related feature points, significantly reducing its interference and consequently enhancing the system’s robustness and localization accuracy. We also built static dense point cloud maps to support advanced tasks of robots. Finally, through testing on the high-speed dataset of TUM RGB-D, it was found that the root mean square error of the absolute trajectory error in this study decreased by an average of 97.10%, compared to ORB-SLAM2. Moreover, tests in real-world scenarios also confirmed the effectiveness of the OMS-SLAM algorithm in dynamic environments.