Author:
Lin Wanyun,Lin Weiming,Chen Gang,Zhang Hejun,Gao Qinquan,Huang Yechong,Tong Tong,Du Min,
Abstract
Combining multi-modality data for brain disease diagnosis such as Alzheimer’s disease (AD) commonly leads to improved performance than those using a single modality. However, it is still challenging to train a multi-modality model since it is difficult in clinical practice to obtain complete data that includes all modality data. Generally speaking, it is difficult to obtain both magnetic resonance images (MRI) and positron emission tomography (PET) images of a single patient. PET is expensive and requires the injection of radioactive substances into the patient’s body, while MR images are cheaper, safer, and more widely used in practice. Discarding samples without PET data is a common method in previous studies, but the reduction in the number of samples will result in a decrease in model performance. To take advantage of multi-modal complementary information, we first adopt the Reversible Generative Adversarial Network (RevGAN) model to reconstruct the missing data. After that, a 3D convolutional neural network (CNN) classification model with multi-modality input was proposed to perform AD diagnosis. We have evaluated our method on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database, and compared the performance of the proposed method with those using state-of-the-art methods. The experimental results show that the structural and functional information of brain tissue can be mapped well and that the image synthesized by our method is close to the real image. In addition, the use of synthetic data is beneficial for the diagnosis and prediction of Alzheimer’s disease, demonstrating the effectiveness of the proposed framework.
Reference42 articles.
1. Adversarial stain transfer for histopathology image analysis.;BenTaieb;IEEE Trans. Med. Imaging,2017
2. Synthesis of positron emission tomography (PET) images via multi-channel generative adversarial networks (GANs);Bi;Proceedings of the Molecular Imaging, Reconstruction and Analysis of Moving Body Organs, and Stroke Imaging and Treatment,2017
3. Multimodal fusion of brain imaging data: a key to finding the missing link (s) in complex mental illness.;Calhoun;Biol. Psychiatry Cogn. Neurosci. Neuroimaging,2016
4. Reversible architectures for arbitrarily deep residual neural networks;Chang;Proceedings of the AAAI Conference on Artificial Intelligence,2018
5. MRI-derived entorhinal and hippocampal atrophy in incipient and very mild Alzheimer’s disease.;Dickerson;Neurobiol. Aging,2001
Cited by
44 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献