A Data Generation Method for Image Flare Removal Based on Similarity and Centrosymmetric Effect
-
Published:2023-09-22
Issue:10
Volume:10
Page:1072
-
ISSN:2304-6732
-
Container-title:Photonics
-
language:en
-
Short-container-title:Photonics
Author:
Jin Zheyan1ORCID, Feng Huajun1, Xu Zhihai1, Chen Yueting1
Affiliation:
1. State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University, Hangzhou 310027, China
Abstract
Image pairs in under-illuminated scenes along with the presence of complex light sources often result in strong flare artifacts in images, affecting both image quality and the performance of downstream visual applications. Removing lens flare and ghosts is a challenging issue, particularly in low-light environments. Existing methods for flare removal are mainly restricted by inadequate simulation and real-world capture, resulting in singular categories of scattered flares and unavailable reflected ghosts. Therefore, a comprehensive deterioration procedure is crucial for generating a dataset for flare removal. We propose a methodology based on spatial position relationships for generating data pairs with flare deterioration, which is supported by theoretical analysis and real-world evaluation. Our procedure is comprehensive and realizes the similarity of scattered flares and the symmetric effect of reflected ghosts. We also construct a real-shot pipeline that respectively processes the effects of scattering and reflective flares, aiming to directly generate data for end-to-end methods. Experimental results demonstrate that our methodology adds diversity to existing flare datasets and constructs a comprehensive mapping procedure for flare data pairs. Our method facilitates the data-driven model to achieve better restoration in flare images and proposes a better evaluation system based on real shots, thus promoting progress in the area of real flare removal.
Funder
National Natural Science Foundation of China Civil Aerospace Pre-Research Project
Subject
Radiology, Nuclear Medicine and imaging,Instrumentation,Atomic and Molecular Physics, and Optics
Reference33 articles.
1. Micro to macro scale simulation coupling for stray light analysis;Crocherie;Opt. Express,2021 2. Flare7K: A Phenomenological Nighttime Flare Removal Dataset;Dai;Adv. Neural Inf. Process. Syst.,2022 3. Wu, Y., He, Q., Xue, T., Garg, R., Chen, J., Veeraraghavan, A., and Barron, J.T. (2021, January 11–17). How to train neural networks for flare removal. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada. 4. Fu, Y., Liu, Y., Li, J., Luo, D., Lv, S., Jv, Y., and Xie, L. (2022, January 22–27). Uformer: A unet based dilated complex & real dual-path conformer network for simultaneous speech enhancement and dereverberation. Proceedings of the ICASSP 2022—2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore. 5. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., and Yang, M.H. (2022, January 18–24). Restormer: Efficient Transformer for High-Resolution Image Restoration. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.
|
|