Deep learning‐based survival prediction of brain tumor patients using attention‐guided 3D convolutional neural network with radiomics approach from multimodality magnetic resonance imaging

Abstract

AbstractAutomatic survival prediction of gliomas from brain magnetic resonance imaging (MRI) volumes is an essential step for a patient's prognosis analysis. Radiomics research delivers beneficial feature information from MRI imaging which is substantially required by clinicians and oncologists for predicting disease prognosis for precise surgical treatment and planning. In recent years, the success of deep learning has been vast in the field of medical imaging, and it shows state‐of‐the‐art performance in applications like segmentation, classification, regression, and detection. Therefore, in this paper, we proposed a collective method using deep learning and radiomics techniques for the survival prediction of brain tumor patients. We first propose a hierarchical channel attention (HAM) module and a multi‐scale‐aware feature enhancement (MSAFE) to efficiently fuse adjacent hierarchical features in the proposed segmentation model. After segmentation, deep/latent features (LCNN) are extracted from the bottom layer of the proposed segmentation model. Later, we extracted selected radiomics features (histogram, location, and shape) using input images and segmented masks from the proposed segmentation model. Further, the 3D deep learning regressor has been trained for 3D regressor‐based deep feature extraction. We proposed the method of overall survival prediction for the brain tumor patients by combining all the meaningful features including clinical features (age) that also favorably contribute to the survival days prediction for the glioma's patients. To predict the survival days for each patient, the selected features are trained to analyze the performance of various regression techniques like random forest (RF), decision tree (DT), and XGBoost. Our proposed combined feature‐based method achieved the highest performance for survival days prediction over the state‐of‐the‐art methods. We also perform extensive experiments to show the effectiveness of each feature extraction method. The experimental results infer that deep learning‐based features along with radiomic features and clinical features are truly vital paradigms to estimate survival days.