Affiliation:
1. College of Engineering, University of Arkansas, Fayetteville, AR 72701, USA
2. Institute for Integrative and Innovative Research, University of Arkansas, Fayetteville, AR 72701, USA
Abstract
When performing remote sensing image segmentation, practitioners often encounter various challenges, such as a strong imbalance in the foreground–background, the presence of tiny objects, high object density, intra-class heterogeneity, and inter-class homogeneity. To overcome these challenges, this paper introduces AerialFormer, a hybrid model that strategically combines the strengths of Transformers and Convolutional Neural Networks (CNNs). AerialFormer features a CNN Stem module integrated to preserve low-level and high-resolution features, enhancing the model’s capability to process details of aerial imagery. The proposed AerialFormer is designed with a hierarchical structure, in which a Transformer encoder generates multi-scale features and a multi-dilated CNN (MDC) decoder aggregates the information from the multi-scale inputs. As a result, information is taken into account in both local and global contexts, so that powerful representations and high-resolution segmentation can be achieved. The proposed AerialFormer was benchmarked on three benchmark datasets, including iSAID, LoveDA, and Potsdam. Comprehensive experiments and extensive ablation studies show that the proposed AerialFormer remarkably outperforms state-of-the-art methods.
Funder
National Science Foundation
Reference117 articles.
1. Schumann, G.J., Brakenridge, G.R., Kettner, A.J., Kashif, R., and Niebuhr, E. (2018). Assisting flood disaster response with earth observation data and products: A critical assessment. Remote Sens., 10.
2. Remote sensing for agricultural applications: A meta-review;Weiss;Remote Sens. Environ.,2020
3. Improving public data for building segmentation from Convolutional Neural Networks (CNNs) for fused airborne lidar and image data using active contours;Griffiths;ISPRS J. Photogramm. Remote Sens.,2019
4. Road segmentation for remote sensing images using adversarial spatial pyramid networks;Shamsolmoali;IEEE Trans. Geosci. Remote Sens.,2020
5. Examining the impacts of future land use/land cover changes on climate in Punjab province, Pakistan: Implications for environmental sustainability and economic growth;Samie;Environ. Sci. Pollut. Res.,2020
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Hi-ResNet: Edge Detail Enhancement for High-Resolution Remote Sensing Segmentation;IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing;2024