SVS-VPR: A Semantic Visual and Spatial Information-Based Hierarchical Visual Place Recognition for Autonomous Navigation in Challenging Environmental Conditions
Author:
Arshad Saba1, Park Tae-Hyoung2ORCID
Affiliation:
1. Industrial Artificial Intelligence Research Center, Chungbuk National University, Cheongju 28644, Republic of Korea 2. Department of Intelligent Systems and Robotics, Chungbuk National University, Cheongju 28644, Republic of Korea
Abstract
Robust visual place recognition (VPR) enables mobile robots to identify previously visited locations. For this purpose, the extracted visual information and place matching method plays a significant role. In this paper, we critically review the existing VPR methods and group them into three major categories based on visual information used, i.e., handcrafted features, deep features, and semantics. Focusing the benefits of convolutional neural networks (CNNs) and semantics, and limitations of existing research, we propose a robust appearance-based place recognition method, termed SVS-VPR, which is implemented as a hierarchical model consisting of two major components: global scene-based and local feature-based matching. The global scene semantics are extracted and compared with pre-visited images to filter the match candidates while reducing the search space and computational cost. The local feature-based matching involves the extraction of robust local features from CNN possessing invariant properties against environmental conditions and a place matching method utilizing semantic, visual, and spatial information. SVS-VPR is evaluated on publicly available benchmark datasets using true positive detection rate, recall at 100% precision, and area under the curve. Experimental findings demonstrate that SVS-VPR surpasses several state-of-the-art deep learning-based methods, boosting robustness against significant changes in viewpoint and appearance while maintaining efficient matching time performance.
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference51 articles.
1. Visual Place Recognition: A Survey;Lowry;IEEE Trans. Robot.,2016 2. Arshad, S., and Kim, G.W. (2021). Role of deep learning in loop closure detection for visual and lidar slam: A survey. Sensors, 21. 3. Sünderhauf, N., Shirazi, S., Jacobson, A., Dayoub, F., Pepperell, E., Upcroft, B., and Milford, M. (2015). Robotics: Science and Systems XI, Sapienza University of Rome. 4. Sünderhauf, N., Shirazi, S., Dayoub, F., Upcroft, B., and Milford, M. (October, January 28). On the performance of ConvNet features for place recognition. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Hamburg, Germany. 5. Fast and incremental method for loop-closure detection using bags of visual words;Angeli;IEEE Trans. Robot.,2008
|
|