Improving the generalization of image denoising via structure‐preserved MLP‐based denoiser and generative diffusion prior

Abstract

AbstractImage denoising aims to remove noise from images and improve the quality of images. However, most image denoising methods heavily rely on pairwise training strategies and strict prior knowledge about image structure or noise distribution. While these methods exhibit significant results when handling known types of noise, their generalization performance diminishes when confronted with images containing unknown noise distributions. To address this issue, a two‐stage approach is introduced for enhancing the generalizability of image denoising. The proposed method does not rely on a large amount of paired data or prior knowledge of the noise type and level. Instead, it constructs a denoising pipeline with improved generalizability through an MLP‐based denoiser and generative diffusion prior. Specifically, in the first stage, an initial denoised image is predicted with a structure resembling that of the underlying clean image by introducing an MLP‐based U‐shaped denoising network aided by an implicit structural prior. In the second stage, the generalizability and quality of the denoiser are further enhanced by conditioning the result obtained from the previous stage on the pretrained denoising diffusion null‐space model. Extensive experimentation on multiple datasets demonstrates that this method exhibits better denoising performance and generalizability than other image denoising methods.