Abstract
UAVs are flexible in action, changeable in shooting angles, and complex and changeable in the shooting environment. Most of the existing stitching algorithms are suitable for images collected by UAVs in static environments, but the images are in fact being captured dynamically, especially in low-altitude flights. Considering that the great changes of the object position may cause the low-altitude aerial images to be affected by the moving foreground during stitching, so as to result in quality problems, such as splicing misalignment and tearing, a UAV aerial image stitching algorithm is proposed based on semantic segmentation and ORB. In the image registration, the algorithm introduces a semantic segmentation network to separate the foreground and background of the image and obtains the foreground semantic information. At the same time, it uses the quadtree decomposition idea and the classical ORB algorithm to extract feature points. By comparing the feature point information with the foreground semantic information, the foreground feature points can be deleted to realize feature point matching. Based on the accurate image registration, the image stitching and fusion will be achieved by the homography matrix and the weighted fusion algorithm. The proposed algorithm not only preserves the details of the original image, but also improves the four objective data points of information entropy, average gradient, peak signal-to-noise ratio and root mean square error. It can solve the problem of splicing misalignment tearing during background stitching caused by dynamic foreground and improves the stitching quality of UAV low-altitude aerial images.
Funder
Outstanding Youth Project of Provincial Natural Science Foundation of China in 2020
National Natural Science Foundation of China
Subject
General Earth and Planetary Sciences
Reference34 articles.
1. Harris, C., and Stephens, M. (1988). Alvey Vision Conference, The Plessey Company Plc.
2. Distinctive Image Features from Scale-Invariant Keypoints;Lowe;Int. J. Comput. Vis.,2004
3. Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7–13). SURF: Speeded up robust features. Proceedings of the 9th European conference on Computer Vision-Volume Part I, Graz, Austria.
4. Rublee, E., Rabaud, V., Konolige, K., and Bradski, G.R. (2011, January 6–13). ORB: An efficient alternative to SIFT or SURF. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.
5. Yeh, C.C., Chang, Y.L., Alkhaleefah, M., Hsu, P.H., Eng, W., Koo, V.C., Huang, B.R., and Chang, L.A. (2021). YOLOv3-Based Matching Approach for Roof Region Detection from Drone Images. Remote Sens., 13.
Cited by
7 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献