Discrete residual diffusion model for high-resolution prostate MRI synthesis

Abstract

Abstract Objective. High-resolution magnetic resonance imaging (HR MRI) is an effective tool for diagnosing PCa, but it requires patients to remain immobile for extended periods, increasing chances of image distortion due to motion. One solution is to utilize super-resolution (SR) techniques to process low-resolution (LR) images and create a higher-resolution version. However, existing medical SR models suffer from issues such as excessive smoothness and mode collapse. In this paper, we propose a novel generative model avoiding the problems of existing models, called discrete residual diffusion model (DR-DM). Approach. First, the forward process of DR-DM gradually disrupts the input via a fixed Markov chain, producing a sequence of latent variables with increasing noise. The backward process learns the conditional transit distribution and gradually match the target data distribution. By optimizing a variant of the variational lower bound, training diffusion models effectively address the issue of mode collapse. Second, to focus DR-DM on recovering high-frequency details, we synthesize residual images instead of synthesizing HR MRI directly. The residual image represents the difference between the HR and LR up-sampled MR image, and we convert residual image into discrete image tokens with a shorter sequence length by a vector quantized variational autoencoder (VQ-VAE), which reduced the computational complexity. Third, transformer architecture is integrated to model the relationship between LR MRI and residual image, which can capture the long-range dependencies between LR MRI and the synthesized imaging and improve the fidelity of reconstructed images. Main results. Extensive experimental validations have been performed on two popular yet challenging magnetic resonance image super-resolution tasks and compared to five state-of-the-art methods. Significance. Our experiments on the Prostate-Diagnosis and PROSTATEx datasets demonstrate that the DR-DM model significantly improves the signal-to-noise ratio of MRI for prostate cancer, resulting in greater clarity and improved diagnostic accuracy for patients.