Affiliation:
1. School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China
Abstract
Infrared sensors capture infrared rays radiated by objects to form thermal images. They have a steady ability to penetrate smoke and fog, and are widely used in security monitoring, military, etc. However, civilian infrared detectors with lower resolution cannot compare with megapixel RGB camera sensors. In this paper, we propose a dynamic attention mechanism-based thermal image super-resolution network for infrared sensors. Specifically, the dynamic attention modules adaptively reweight the outputs of the attention and non-attention branches according to features at different depths of the network. The attention branch, which consists of channel- and pixel-wise attention blocks, is responsible for extracting the most informative features, while the non-attention branch is adopted as a supplement to extract the remaining ignored features. The dynamic weights block operates with 1D convolution instead of the full multi-layer perceptron on the global average pooled features, reducing parameters and enhancing information interaction between channels, and the same structure is adopted in the channel attention block. Qualitative and quantitative results on three testing datasets demonstrate that the proposed network can superior restore high-frequency details while improving the resolution of thermal images. And the lightweight structure of the proposed network with lower computing cost can be practically deployed on edge devices, effectively improving the imaging perception quality of infrared sensors.
Funder
National Natural Science Foundation of China
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference70 articles.
1. Thermal image super-resolution via multi-path residual attention network;Zhang;Signal Image Video Process.,2023
2. Chudasama, V., Patel, H., Prajapati, K., Upla, K.P., Ramachandra, R., Raja, K., and Busch, C. (2020, January 13–19). Therisurnet—A computationally efficient thermal image super-resolution network. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.
3. Deep learning for image super-resolution: A survey;Wang;IEEE Trans. Pattern Anal. Mach. Intell.,2020
4. Super-resolution image reconstruction: A technical overview;Park;IEEE Signal Process. Mag.,2003
5. New edge-directed interpolation;Li;IEEE Trans. Image Process.,2001
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Comparative Study on Various Sensors for Monitoring the Construction Sites;2024 International Conference on Science Technology Engineering and Management (ICSTEM);2024-04-26
2. Bidirectional Temporal Fusion Video Denoising Based on W-Net;Proceedings of the 2023 7th International Conference on Video and Image Processing;2023-12-14
3. Multi-scale feature and correlation volumes for Video Interpolation;Proceedings of the 2023 7th International Conference on Video and Image Processing;2023-12-14