Multi-Attention Residual Network for Image Super Resolution

Abstract

Recently, many studies have shown that deep convolutional neural network can achieve superior performance in image super resolution (SR). The majority of current CNN-based SR methods tend to use deeper architecture to get excellent performance. However, with the growing depth and width of network, the hierarchical features from low-resolution (LR) images cannot be exploited effectively. On the other hand, most models lack the ability of discriminating different types of information and treating them equally, which results in limiting the representational capacity of the models. In this study, we propose the multi-attention residual network (MARN) to address these problems. Specifically, we propose a new multi-attention residual block (MARB), which is composed of attention mechanism and multi-scale residual network. At the beginning of each residual block, the channel importance of image features is adaptively recalibrated by attention mechanism. Then, we utilize convolutional kernels of different sizes to adaptively extract the multi-attention features on different scales. At the end of blocks, local multi-attention features fusion is applied to get more effective hierarchical features. After obtaining the outputs of each MARB, global hierarchical feature fusion jointly fuses all hierarchical features for reconstructing images. Our extensive experiments show that our model outperforms most of the state-of-the-art methods.