Affiliation:
1. State Key Laboratory of Networking and Switching Technology, BUPT; School of Computer, BUPT, China
Abstract
Image enhancement methods leveraging learning-based approaches have demonstrated impressive results when trained on synthetic degraded-clear image pairs. However, when deployed in real-world scenarios, such models often suffer significant performance degradation due to the inherent domain gap between synthetic and real degradations. To bridge this gap, we propose a novel
T
wo-stage
C
ontrastive
D
omain
A
daptation image
E
nhancement framework (
TCDAE
) consisting of two key strategies: 1)
S
ynthetic-to-
R
eal
D
omain
T
ransfer
L
earning (
S2R-DTL
) that effectively translates images from the synthetic degraded domain to the real degraded domain, aligning the domains at the pixel level, and 2)
D
egraded-to-
C
lear
D
omain
T
ransfer
L
earning (
D2C-DTL
) that further adapts the enhancement model from the synthetic to the real domain by translating images from the real degraded domain to the real clean domain in both supervised and unsupervised branches. A unique aspect of our approach is the integration of a
Do
main
N
oise
C
ontrastive
E
stimation (
DoNCE
) loss in both learning strategies. This specialized loss formulation enables TCDAE to robustly translate images across domains, even in scenarios lacking strong positive examples. Consequently, our framework can generate enhanced images with natural, realistic appearances akin to real clear images. Comprehensive experiments on real-world degraded scenes across diverse tasks including dehazing, deraining, and deblurring demonstrate the superiority of TCDAE over state-of-the-art methods, achieving improved visual quality, quantitative metrics, and downstream task performance.
Publisher
Association for Computing Machinery (ACM)
Reference80 articles.
1. Codruta O Ancuti, Cosmin Ancuti, Mateu Sbert, and Radu Timofte. 2019. Dense-haze: A benchmark for image dehazing with dense-haze and haze-free images. In ICIP. IEEE, 1014–1018.
2. Codruta O Ancuti, Cosmin Ancuti, and Radu Timofte. 2020. NH-HAZE: An image dehazing benchmark with non-homogeneous hazy and haze-free images. In CVPRW. IEEE, 444–445.
3. Dana Berman Shai Avidan et al. 2016. Non-local image dehazing. In CVPR. IEEE 1674–1682.
4. Konstantinos Bousmalis, Nathan Silberman, David Dohan, Dumitru Erhan, and Dilip Krishnan. 2017. Unsupervised pixel-level domain adaptation with generative adversarial networks. In CVPR. IEEE, 3722–3731.
5. DehazeNet: An End-to-End System for Single Image Haze Removal