Affiliation:
1. School of Electronic Information, Wuhan University, Luojia Mountain Road, Wuhan 430072, China
Abstract
The single-image super-resolution task benefits has a wide range of application scenarios, so has long been a hotspot in the field of computer vision. However, designing a continuous-scale super-resolution algorithm with excellent performance is still a difficult problem to solve. In order to solve this problem, we propose a continuous-scale SR algorithm based on a Transformer, which is called residual dense Swin Transformer (RDST). Firstly, we design a residual dense Transformer block (RDTB) to enhance the information flow before and after the network and extract local fusion features. Then, we use multilevel feature fusion to obtain richer feature information. Finally, we use the upsampling module based on the local implicit image function (LIIF) to obtain continuous-scale super-resolution results. We test RDST on multiple benchmarks. The experimental results show that RDST achieves SOTA performance in the fixed scale of super-resolution tasks in the distribution, and significantly improves (0.1∼0.6 dB) the arbitrary scale of super-resolution tasks out of distribution. Sufficient experiments show that our RDST can use fewer parameters, and its performance is better than the SOTA SR method.
Funder
National Natural Science Foundation of China
National Key Research and Development Program of China
Reference39 articles.
1. Huang, Y., Shao, L., and Frangi, A.F. (2017, January 21–26). Simultaneous Super-Resolution and Cross-Modality Synthesis of 3D Medical Images Using Weakly-Supervised Joint Convolutional Sparse Coding. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.
2. Image super-resolution using progressive generative adversarial networks for medical image analysis;Mahapatra;Comput. Med Imaging Graph.,2019
3. Super-Resolution Reconstruction for Multi-Angle Remote Sensing Images Considering Resolution Differences;Zhang;Remote Sens.,2014
4. Remote Sensing Image Super-Resolution Using Second-Order Multi-Scale Networks;Dong;IEEE Trans. Geosci. Remote. Sens.,2021
5. Liu, W., Lin, D., and Tang, X. (2005, January 20–26). Hallucinating faces: TensorPatch super-resolution and coupled residue compensation. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.