Super-Resolution Learning Strategy Based on Expert Knowledge Supervision
-
Published:2024-08-07
Issue:16
Volume:16
Page:2888
-
ISSN:2072-4292
-
Container-title:Remote Sensing
-
language:en
-
Short-container-title:Remote Sensing
Author:
Ren Zhihan1ORCID, He Lijun1ORCID, Zhu Peipei2ORCID
Affiliation:
1. School of Information and Communications Engineering, Xi’an Jiaotong University, Xi’an 710049, China 2. School of Science and Engineering, Chinese University of Hong Kong, Shenzhen 518172, China
Abstract
Existing Super-Resolution (SR) methods are typically trained using bicubic degradation simulations, resulting in unsatisfactory results when applied to remote sensing images that contain a wide variety of object shapes and sizes. The insufficient learning approach reduces the focus of models on critical object regions within the images. As a result, their practical performance is significantly hindered, especially in real-world applications where accuracy in object reconstruction is crucial. In this work, we propose a general learning strategy for SR models based on expert knowledge supervision, named EKS-SR, which can incorporate a few coarse-grained semantic information derived from high-level visual tasks into the SR reconstruction process. It utilizes prior information from three perspectives: regional constraints, feature constraints, and attributive constraints, to guide the model to focus more on the object regions within the images. By integrating these expert knowledge-driven constraints, EKS-SR can enhance the model’s ability to accurately reconstruct object regions and capture the key information needed for practical applications. Importantly, this improvement does not increase the inference time and does not require full annotation of the large-scale datasets, but only a few labels, making EKS-SR both efficient and effective. Experimental results demonstrate that the proposed method can achieve improvements in both reconstruction quality and machine vision analysis performance.
Funder
National Science and Technology Major Project
Reference65 articles.
1. Shafique, A., Cao, G., Khan, Z., Asad, M., and Aslam, M. (2022). Deep learning-based change detection in remote sensing images: A review. Remote Sens., 14. 2. Wang, G., Li, B., Zhang, T., and Zhang, S. (2022). A network combining a transformer and a convolutional neural network for remote sensing image change detection. Remote Sens., 14. 3. Yang, L., Chen, Y., Song, S., Li, F., and Huang, G. (2021). Deep Siamese networks based change detection with remote sensing images. Remote Sens., 13. 4. Cross-domain association mining based generative adversarial network for pansharpening;He;IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.,2022 5. Tang, D., Cao, X., Hou, X., Jiang, Z., and Meng, D. (2024). Crs-diff: Controllable generative remote sensing foundation model. arXiv.
|
|