Research on multi‐center assisted diagnosis of ASD based on multimodal feature fusion

Abstract

AbstractAutism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder, and structural magnetic resonance imaging (sMRI) and functional magnetic resonance imaging (fMRI) provide information about brain structure and function, aiding in objective ASD diagnosis. However, existing ASD classification methods face challenges such as sample scarcity, inter‐imaging center variations, insufficient single‐modality information, and inconsistent feature dimensions. This study introduced a method based on the Local Global Multimodal Domain Adaptation (LGMDA)‐Sparse Adaptive Prior Coupled Dictionary Learning (SACDL) framework. Initially, the LGMDA method was introduced to achieve multi‐source DA. By minimizing differences between different data domains while maximizing inter‐class differences within the same domain, it expands the sample size of multi‐modal data, addressing the issues of sample scarcity and heterogeneity in ASD data. Subsequently, the SACDL method was employed for multimodal fusion. It initialized dictionaries using the ATGP algorithm, combined sMRI and fMRI data for dictionary learning, adaptively adjusted sparsity parameters, and integrated ASD phenotype data for constrained optimization. It enables joint learning of shared and modality‐specific features, balancing differences in feature dimensions. Experimental results show that this model effectively utilizes multi‐center, multi‐modal information to achieve better auxiliary diagnosis than single‐modal small samples. This method has the potential to provide effective solutions for ASD multi‐source and multi‐modal classification problems, which are significant for ASD research and clinical diagnosis.