Author:
Liu Xiaonan,Chen Kewei,Wu Teresa,Weidman David,Lure Fleming Y. M.,Li Jing,
Abstract
AbstractMultimodality datasets are becoming increasingly common in various domains to provide complementary information for predictive analytics. In health care, diagnostic imaging of different kinds contains complementary information about an organ of interest, which allows for building a predictive model to accurately detect a certain disease. In manufacturing, multi-sensory datasets contain complementary information about the process and product, allowing for more accurate quality assessment. One significant challenge in fusing multimodality data for predictive analytics is that the multiple modalities are not universally available for all samples due to cost and accessibility constraints. This results in a unique data structure called Incomplete Multimodality Dataset (IMD) for which existing statistical models fall short. We propose a novel Incomplete-Multimodality Transfer Learning (IMTL) model that builds a predictive model for each sub-cohort of samples with the same missing modality pattern, and meanwhile couples the model estimation processes for different sub-cohorts to allow for transfer learning. We develop an Expectation-Maximization (EM) algorithm to estimate the parameters of IMTL and further extend it to a collaborative learning paradigm that is specifically valuable for patient privacy preservation in health care applications of the IMTL. We prove two advantageous properties of IMTL: the ability for out-of-sample prediction and a theoretical guarantee for a larger Fisher information compared with models without transfer learning. IMTL is applied to diagnosis and prognosis of the Alzheimer’s Disease (AD) at an early stage of the disease called Mild Cognitive Impairment (MCI) using incomplete multimodality imaging data. IMTL achieves higher accuracy than competing methods without transfer learning.
Publisher
Cold Spring Harbor Laboratory
Reference25 articles.
1. Albert, Marilyn S. , Steven T. DeKosky , Dennis Dickson , Bruno Dubois , Howard H. Feldman , Nick C. Fox , Anthony Gamst , et al. (2011) The Diagnosis of Mild Cognitive Impairment due to Alzheimer’s Disease: Recommendations from the National Institute on Aging-Alzheimer’s Association Workgroups on Diagnostic Guidelines for Alzheimer’s Disease. Alzheimer’s and Dementia 7(3).
2. Bailly, Matthieu , Christophe Destrieux , Caroline Hommet , Karl Mondon , Jean-Philippe Cottier , Emilie Beaufils , Emilie Vierron , et al. (2015) Precuneus and Cingulate Cortex Atrophy and Hypometabolism in Patients with Alzheimer’s Disease and Mild Cognitive Impairment: MRI and 18F-FDG PET Quantitative Analysis Using FreeSurfer, Precuneus and Cingulate Cortex Atrophy and Hypometabolism in P.” BioMed Research International, BioMed Research International 2015.
3. Engine fault diagnosis based on multi-sensor information fusion using Dempster–Shafer evidence theory
4. Chen, Kewei , Napatkamon Ayutyanont , Jessica B.S. Langbaum , Adam S. Fleisher , Cole Reschke , Wendy Lee , Xiaofen Liu , et al. (2011). Characterizing Alzheimer’s Disease Using a Hypometabolic Convergence Index. NeuroImage 56 (1).
5. Chen, Kewei , Jessica B.S. Langbaum , Adam S. Fleisher , Napatkamon Ayutyanont , Cole Reschke , Wendy Lee , Xiaofen Liu , et al. (2010) Twelve-Month Metabolic Declines in Probable Alzheimer’s Disease and Amnestic Mild Cognitive Impairment Assessed Using an Empirically Pre-Defined Statistical Region-of-Interest: Findings from the Alzheimer’s Disease Neuroimaging Initiative. NeuroImage 51 (2).