TS-AI: A deep learning pipeline for multimodal subject-specific parcellation with task contrasts synthesis

Abstract

AbstractAccurate mapping of brain functional subregions at an individual level is crucial. Task-based functional MRI (tfMRI) captures subject-specific activation patterns during various functions and behaviors, facilitating the individual localization of functionally distinct subregions. However, acquiring high-quality tfMRI is time-consuming and resource-intensive in both scientific and clinical settings. The present study proposes a two-stage network model, TS-AI, to individualize an atlas on cortical surfaces through the prediction of tfMRI data. TS-AI first synthesizes a battery of task contrast maps for each individual by leveraging tract-wise anatomical connectivity and resting-state networks. These synthesized maps, along with feature maps of tract-wise anatomical connectivity and resting-state networks, are then fed into an end-to-end deep neural network to individualize an atlas. TS-AI enables the synthesized task contrast maps to be used in individual parcellation without the acquisition of actual task fMRI scans. In addition, a novel feature consistency loss is designed to assign vertices with similar features to the same parcel, which increases individual specificity and mitigates overfitting risks caused by the absence of individual parcellation ground truth. The individualized parcellations were validated by assessing test-retest reliability, homogeneity, and cognitive behavior prediction using diverse reference atlases and datasets, demonstrating the superior performance and generalizability of TS-AI. Sensitivity analysis yielded insights into region-specific features influencing individual variation in functional regionalization. In addition, TS-AI identified accelerated shrinkage in the medial temporal and cingulate parcels during the progression of Alzheimer’s disease, suggesting its potential in clinical research and applications.