Enhanced pyramidal residual networks for single image super-resolution

Abstract

AbstractSeveral super-resolution (SR) techniques are introduced in the literature, including traditional and machine learning-based algorithms. Especially, deep learning-based SR approaches emerge with demands for better quality images providing deeper subpixel enhancement. Dealing with the image enhancement task in the satellite images domain, a new SR method for single image SR, namely Enhanced Deep Pyramidal Residual Networks, is introduced in this study. The proposed method overcomes the potential instability problem of Enhanced Deep Residual Networks for Single Image Super-Resolution (EDSR) approach by gradually increasing the feature maps depending upon Pyramidal Residual Networks architecture. The EDSR itself is a good algorithm in the SR domain. However, it has a strict structure for increasing the block size. To overcome this problem with the aim of increasing the algorithm’s performance, the pyramidal residual networks gradually increasing hypothesis is utilized in the proposed approach, which is the main contribution and novelty of this study. Besides, by using the pyramidal residual networks gradually increasing hypothesis in the proposed approach, the parameter size of the models is also reduced, which affects the computational time. Two different models are proposed by considering addition and multiplication manners, and the proposed models are evaluated using well-known remote sensing datasets NWPU-RESISC45 and UC Merced. The results obtained by the proposed model are compared with the results of traditional image enhancement algorithms together with the EDSR itself, EDSR with deeper structure, Super-Resolution Generative Adversarial Networks approach, and Residual Local Feature Networks approach in terms of peak signal to noise ratio (PSNR) and structural similarity index measure (SSIM) metrics and showed that the proposed models present better quality images. Moreover, considering the computational time and complexity, it is shown that some proposed models achieve approximately 27% less output parameter having similar PSNR and SSIM values and computational time for EDSR itself and 65% less output parameter having better PSNR and SSIM values and 16% lower computational time for EDSR with deeper structure.