Semantic-Guided Iterative Detail Fusion Network for Single-Image Deraining
-
Published:2024-09-12
Issue:18
Volume:13
Page:3634
-
ISSN:2079-9292
-
Container-title:Electronics
-
language:en
-
Short-container-title:Electronics
Author:
Wang Zijian12, Xu Lulu1ORCID, Rong Wen2, Yao Xinpeng2, Chen Ting1ORCID, Zhao Peng1, Chen Yuxiu1
Affiliation:
1. School of Information Engineering, Chang’an University, Xi’an 710064, China 2. Shandong Hi-Speed Group Co., Ltd., Innovation Research Institute, Jinan 271039, China
Abstract
Existing approaches for image deraining often rely on synthetic or unpaired real-world rainy datasets, leading to sub-optimal generalization ability when processing the complex and diverse real-world rain degradation. To address these challenges, we propose a novel iterative semantic-guided detail fusion model with implicit neural representations (INR-ISDF). This approach addresses the challenges of complex solution domain variations, reducing the usual negative impacts found in these situations. Firstly, the input rainy images are processed through implicit neural representations (INRs) to obtain normalized images. Residual calculations are then used to assess the illumination inconsistency caused by rain degradation, thereby enabling an accurate identification of the degradation locations. Subsequently, the location information is incorporated into the detail branch of the dual-branch architecture, while the normalized images obtained from the INR are used to enhance semantic processing. Finally, we use semantic clues to iteratively guide the progressive fusion of details to achieve improved image processing results. To tackle the partial correspondence between real rain images and the given ground truth, we propose a two-stage training strategy that utilizes adjustments in the semantic loss function coefficients and phased freezing of the detail branch to prevent potential overfitting issues. Extensive experiments verify the effectiveness of our proposed method in eliminating the degradation in real-world rainy images.
Funder
National R&D Program of China Shaanxi International S&T Cooperation Program Project National Natural Science Foundation of China Fundamental Research Funds for the Central Universities
Reference53 articles.
1. Pixel-wise content attention learning for single-image deraining of autonomous vehicles;Jiang;Expert Syst. Appl.,2023 2. Personnel trajectory extraction from port-like videos under varied rainy interferences;Chen;IEEE Trans. Intell. Transp. Syst.,2024 3. Attention-based deep learning framework for action recognition in a dark environment;Munsif;Hum. Centric Comput. Inf. Sci,2024 4. Munsif, M., Afridi, H., Ullah, M., Khan, S.D., Alaya Cheikh, F., and Sajjad, M. (2022, January 11–14). A Lightweight Convolution Neural Network for Automatic Disasters Recognition. Proceedings of the 2022 10th European Workshop on Visual Information Processing (EUVIP), Lisbon, Portugal. 5. Yi, Q., Li, J., Dai, Q., Fang, F., Zhang, G., and Zeng, T. (2021, January 11–17). Structure-preserving deraining with residue channel prior guidance. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.
|
|