Snow Detection in Gaofen-1 Multi-Spectral Images Based on Swin-Transformer and U-Shaped Dual-Branch Encoder Structure Network with Geographic Information

Author:

Wu Yue1,Shi Chunxiang2,Shen Runping1ORCID,Gu Xiang2,Tie Ruian2,Ge Lingling2,Sun Shuai23ORCID

Affiliation:

1. School of Geographical Sciences, Nanjing University of Information Science and Technology, Nanjing 210044, China

2. National Meteorological Information Center, Beijing 100044, China

3. Key Laboratory of Coupling Process and Effect of Natural Resources Elements, Beijing 100055, China

Abstract

Snow detection is imperative in remote sensing for various applications, including climate change monitoring, water resources management, and disaster warning. Recognizing the limitations of current deep learning algorithms in cloud and snow boundary segmentation, as well as issues like detail snow information loss and mountainous snow omission, this paper presents a novel snow detection network based on Swin-Transformer and U-shaped dual-branch encoder structure with geographic information (SD-GeoSTUNet), aiming to address the above issues. Initially, the SD-GeoSTUNet incorporates the CNN branch and Swin-Transformer branch to extract features in parallel and the Feature Aggregation Module (FAM) is designed to facilitate the detail feature aggregation via two branches. Simultaneously, an Edge-enhanced Convolution (EeConv) is introduced to promote snow boundary contour extraction in the CNN branch. In particular, auxiliary geographic information, including altitude, longitude, latitude, slope, and aspect, is encoded in the Swin-Transformer branch to enhance snow detection in mountainous regions. Experiments conducted on Levir_CS, a large-scale cloud and snow dataset originating from Gaofen-1, demonstrate that SD-GeoSTUNet achieves optimal performance with the values of 78.08%, 85.07%, and 92.89% for IoU_s, F1_s, and MPA, respectively, leading to superior cloud and snow boundary segmentation and thin cloud and snow detection. Further, ablation experiments reveal that integrating slope and aspect information effectively alleviates the omission of snow detection in mountainous areas and significantly exhibits the best vision under complex terrain. The proposed model can be used for remote sensing data with geographic information to achieve more accurate snow extraction, which is conducive to promoting the research of hydrology and agriculture with different geospatial characteristics.

Funder

advanced research on civil space technology during the 14th Five-Year Plan

National Science Foundation of China

Open Foundation of the Key Laboratory of Coupling Process and Effect of Natural Resources Elements

National Meteorological Information Center of China Meteorological

GHFUND C

Publisher

MDPI AG

Reference67 articles.

1. Influence of the seasonal snow cover on the ground thermal regime: An overview;Zhang;Rev. Geophys.,2005

2. Zhang, Y. (2015). Multivariate Land Snow Data Assimilation in the Northern Hemisphere: Development, Evaluation and Uncertainty Quantification of the Extensible Data Assimilation System. [Ph.D. Thesis, The University of Texas at Austin].

3. Climate change vs. socio-economic development: Understanding the future South Asian water gap;Wijngaard;Hydrol. Earth Syst. Sci.,2018

4. Potential impacts of a warming climate on water availability in snow-dominated regions;Barnett;Nature,2005

5. Climate change decisive for Asia’s snow meltwater supply;Kraaijenbrink;Nat. Clim. Chang.,2021

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3