A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment
Author:
Zhao Chenhao1, Wu Dewei2, He Jing2, Dai Chuanjin2
Affiliation:
1. Graduate School, Air Force Engineering University, Xi’an 710077, China 2. School of Information and Navigation, Air Force Engineering University, Xi’an 710077, China
Abstract
Visual positioning is a basic component for UAV operation. The structure-based methods are, widely applied in most literature, based on local feature matching between a query image that needs to be localized and a reference image with a known pose and feature points. However, the existing methods still struggle with the different illumination and seasonal changes. In outdoor regions, the feature points and descriptors are similar, and the number of mismatches will increase rapidly, leading to the visual positioning becoming unreliable. Moreover, with the database growing, the image retrieval and feature matching are time-consuming. Therefore, in this paper, we propose a novel hierarchical visual positioning method, which includes map construction, landmark matching and pose calculation. First, we combine brain-inspired mechanisms and landmarks to construct a cognitive map, which can make image retrieval efficient. Second, the graph neural network is utilized to learn the inner relations of the feature points. To improve matching accuracy, the network uses the semantic confidence in matching score calculations. Besides, the system can eliminate the mismatches by analyzing all the matching results in the same landmark. Finally, we calculate the pose by using a PnP solver. Furthermore, we evaluate both the matching algorithm and the visual positioning method experimentally in the simulation datasets, where the matching algorithm performs better in some scenes. The results demonstrate that the retrieval time can be shortened by three-thirds with an average positioning error of 10.8 m.
Funder
National Natural Science Foundation of China
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference28 articles.
1. Research on Visual Autonomous Navigation Indoor for Unmanned Aerial Vehicle;Zhang;J. Shanghai Jiaotong Univ.,2017 2. Xu, M., Wang, L., Ren, J., and Poslad, S. (November, January 30). Use of LSTM Regression and Rotation Classification to Improve Camera Pose Localization Estimation. Proceedings of the 2020 IEEE 14th International Conference on Anti-Counterfeiting, Security, and Identification (ASID), Xiamen, China. 3. Zhang, Z., Xu, M., Zhou, W., Peng, T., Li, L., and Poslad, S. (2022). BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Images. arXiv. 4. Sarlin, P.E., Cadena, C., Siegwart, R., and Dymczyk, M. (2019, January 16–20). From coarse to fine: Robust hierarchical localization at large scale. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA. 5. Sattler, T., Weyand, T., Leibe, B., and Kobbelt, L. (2012, January 3–7). Image Retrieval for Image-Based Localization Revisited. Proceedings of the BMVC, Surrey, UK.
|
|