Enhancing Remote Sensing Image Super-Resolution with Efficient Hybrid Conditional Diffusion Model
-
Published:2023-07-07
Issue:13
Volume:15
Page:3452
-
ISSN:2072-4292
-
Container-title:Remote Sensing
-
language:en
-
Short-container-title:Remote Sensing
Author:
Han Lintao12ORCID, Zhao Yuchen1, Lv Hengyi1, Zhang Yisa1, Liu Hailong1, Bi Guoling1, Han Qing3
Affiliation:
1. Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China 2. College of Materials Science and Opto-Electronic Technology, University of Chinese Academy of Sciences, Beijing 100049, China 3. College of Physics and Telecommunication Engineering, Zhoukou Normal University, Zhoukou 466001, China
Abstract
Recently, optical remote-sensing images have been widely applied in fields such as environmental monitoring and land cover classification. However, due to limitations in imaging equipment and other factors, low-resolution images that are unfavorable for image analysis are often obtained. Although existing image super-resolution algorithms can enhance image resolution, these algorithms are not specifically designed for the characteristics of remote-sensing images and cannot effectively recover high-resolution images. Therefore, this paper proposes a novel remote-sensing image super-resolution algorithm based on an efficient hybrid conditional diffusion model (EHC-DMSR). The algorithm applies the theory of diffusion models to remote-sensing image super-resolution. Firstly, the comprehensive features of low-resolution images are extracted through a transformer network and CNN to serve as conditions for guiding image generation. Furthermore, to constrain the diffusion model and generate more high-frequency information, a Fourier high-frequency spatial constraint is proposed to emphasize high-frequency spatial loss and optimize the reverse diffusion direction. To address the time-consuming issue of the diffusion model during the reverse diffusion process, a feature-distillation-based method is proposed to reduce the computational load of U-Net, thereby shortening the inference time without affecting the super-resolution performance. Extensive experiments on multiple test datasets demonstrated that our proposed algorithm not only achieves excellent results in quantitative evaluation metrics but also generates sharper super-resolved images with rich detailed information.
Funder
National Natural Science Foundation of China
Subject
General Earth and Planetary Sciences
Reference51 articles.
1. Wang, X., Yi, J., Guo, J., Song, Y., Lyu, J., Xu, J., Yan, W., Zhao, J., Cai, Q., and Min, H. (2022). A Review of Image Super-Resolution Approaches Based on Deep Learning and Applications in Remote Sensing. Remote Sens., 14. 2. Liu, J., Yuan, Z., Pan, Z., Fu, Y., Liu, L., and Lu, B. (2022). Diffusion Model with Detail Complement for Super-Resolution of Remote Sensing. Remote Sens., 14. 3. Ma, W., Pan, Z., Yuan, F., and Lei, B. (2019). Super-Resolution of Remote Sensing Images via a Dense Residual Generative Adversarial Network. Remote Sens., 11. 4. Gu, J., Sun, X., Zhang, Y., Fu, K., and Wang, L. (2019). Deep Residual Squeeze and Excitation Network for Remote Sensing Image Super-Resolution. Remote Sens., 11. 5. Image Super-Resolution Using Deep Convolutional Networks;Dong;IEEE Trans. Pattern Anal. Mach. Intell.,2016
Cited by
10 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|