Abstract
Existing fusion rules focus on retaining detailed information in the source image, but as the thermal radiation information in infrared images is mainly characterized by pixel intensity, these fusion rules are likely to result in reduced saliency of the target in the fused image. To address this problem, we propose an infrared and visible image fusion model based on significant target enhancement, aiming to inject thermal targets from infrared images into visible images to enhance target saliency while retaining important details in visible images. First, the source image is decomposed with multi-level Gaussian curvature filtering to obtain background information with high spatial resolution. Second, the large-scale layers are fused using ResNet50 and maximizing weights based on the average operator to improve detail retention. Finally, the base layers are fused by incorporating a new salient target detection method. The subjective and objective experimental results on TNO and MSRS datasets demonstrate that our method achieves better results compared to other traditional and deep learning-based methods.
Funder
National Natural Science Foundation of China
Subject
General Physics and Astronomy
Reference46 articles.
1. Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network;Inf. Fusion,2022
2. Infrared and visible image fusion based on target-enhanced multiscale transform decomposition;Inf. Sci.,2020
3. Zhou, S.Y., Yang, P.X., and Xie, W.L. (2011, January 26–28). Infrared image segmentation based on Otsu and genetic algorithm. Proceedings of the 2011 International Conference on Multimedia Technology, Hangzhou, China.
4. Zhao, Y.F., Cheng, J.C., Zhou, W., Zhang, C.X., and Pan, X. (2019, January 18–21). Infrared pedestrian detection with converted temperature map. Proceedings of the 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Lanzhou, China.
5. SwinFusion: Cross-domain long-range learning for general image fusion via swin transformer;IEEE/CAA J. Autom. Sin.,2022
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献