Abstract
AbstractEarly detection of Alzheimer’s Disease (AD) is crucial to ensure timely interventions and optimize treatment outcomes for patients. While integrating multi-modal neuroimages, such as MRI and PET, has shown great promise, limited research has been done to effectively handle incomplete multi-modal image datasets in the integration. To this end, we propose a deep learning-based framework that employs Mutual Knowledge Distillation (MKD) to jointly model different sub-cohorts based on their respective available image modalities. In MKD, the model with more modalities (e.g., MRI and PET) is considered a teacher while the model with fewer modalities (e.g., only MRI) is considered a student. Our proposed MKD framework includes three key components: First, we design a teacher model that is student-oriented, namely the Student-oriented Multi-modal Teacher (SMT), through multi-modal information disentanglement. Second, we train the student model by not only minimizing its classification errors but also learning from the SMT teacher. Third, we update the teacher model by transfer learning from the student’s feature extractor because the student model is trained with more samples. Evaluations on Alzheimer’s Disease Neuroimaging Initiative (ADNI) datasets highlight the effectiveness of our method. Our work demonstrates the potential of using AI for addressing the challenges of incomplete multi-modal neuroimage datasets, opening new avenues for advancing early AD detection and treatment strategies.
Publisher
Cold Spring Harbor Laboratory
Reference25 articles.
1. 2023 Alzheimer's disease facts and figures
2. Ashburner, J. , Barnes, G. , Chen, C. C. , Daunizeau, J. , Flandin, G. , Friston, K. , … & Penny, W. (2014). SPM12 manual. Wellcome Trust Centre for Neuroimaging, London, UK, 2464(4).
3. FDA approves new treatment for Alzheimer’s disease;Mental Health Weekly,2023
4. Chen, Y. , Pan, Y. , Xia, Y. , & Yuan, Y. (2023). Disentangle First, Then Distill: A Unified Framework for Missing Modality Imputation and Alzheimer’s Disease Diagnosis. IEEE Transactions on Medical Imaging.
5. Garcia, N. C. , Morerio, P. , & Murino, V. (2018). Modality distillation with multiple stream networks for action recognition. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 103–118).