Affiliation:
1. International School, Beijing University of Posts and Telecommunications, Beijing 100876, China
2. School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China
Abstract
In unmanned aerial vehicle (UAV) large-scale scene modeling, challenges such as missed shots, low overlap, and data gaps due to flight paths and environmental factors, such as variations in lighting, occlusion, and weak textures, often lead to incomplete 3D models with blurred geometric structures and textures. To address these challenges, an implicit–explicit coupling enhancement for a UAV large-scale scene modeling framework is proposed. Benefiting from the mutual promotion of implicit and explicit models, we initially address the issue of missing co-visibility clusters caused by environmental noise through large-scale implicit modeling with UAVs. This enhances the inter-frame photometric and geometric consistency. Subsequently, we enhance the multi-view point cloud reconstruction density via synthetic co-visibility clusters, effectively recovering missing spatial information and constructing a more complete dense point cloud. Finally, during the mesh modeling phase, high-quality 3D modeling of large-scale UAV scenes is achieved by inversely radiating and mapping additional texture details into 3D voxels. The experimental results demonstrate that our method achieves state-of-the-art modeling accuracy across various scenarios, outperforming existing commercial UAV aerial photography software (COLMAP 3.9, Context Capture 2023, PhotoScan 2023, Pix4D 4.5.6) and related algorithms.
Funder
Beijing Natural Science Foundation
National Natural Science Foundation of China
Reference42 articles.
1. Aerial orthoimage generation for UAV remote sensing: Review;Zhang;Inf. Fusion,2023
2. An update on automatic 3D building reconstruction;Haala;ISPRS J. Photogramm. Remote Sens.,2010
3. Results of the ISPRS benchmark on urban object detection and 3D building reconstruction;Rottensteiner;ISPRS J. Photogramm. Remote Sens.,2014
4. Snavely, N., Seitz, S.M., and Szeliski, R. (August, January 30). Photo tourism: Exploring photo collections in 3D. Proceedings of the ACM Siggraph 2006 Papers, Boston, MA, USA.
5. Wu, C. (July, January 29). Towards Linear-Time Incremental Structure from Motion. Proceedings of the 2013 International Conference on 3D Vision—3DV 2013, Seattle, WA, USA.