Investigating performance of deep learning and machine learning risk stratification of Asian in-hospital patients after ST-elevation myocardial infarction

Abstract

Abstract Background Machine learning (ML) algorithm support vector machine (SVM) performed better than Thrombolysis in Myocardial Infarction (TIMI) score for ASIAN STEMI patients. However, Deep Learning (DL) effectiveness in the multiethnic ASIAN population has yet to be determined. DL has automatic learning of the feature from a given dataset without the need to conduct feature selection. However, the selected features by the algorithm is black box. Identifying features associated with mortality is essential to recognize characteristics of patients with high risk for better patient management. Purpose To develop a DL algorithm for in-hospital mortality in multiethnic STEMI patients using predictors identified from the SVM algorithm. To investigate DL performance constructed using predictors from SVM feature extraction and expert-recommended predictors. Methods We constructed four algorithms; a) DL and SVM algorithms with predictors identified from the SVM variable importance b) DL and SVM using predictors based on expert recommendation. We used registry data from the National Cardiovascular Disease Database of 11397 patient's. Fifty parameters including demographics, cardiovascular risk, medications and clinical variables were considered. The Area under the curve (AUC) is the performance evaluation metric. Algorithms were validated against the TIMI and tested using the same validation data. SVM variable importance with backward elimination was used to select and rank important variables. Results DL algorithms outperform SVM and TIMI on the validation dataset; i) DL with SVM selected predictors (15 predictors, AUC = 0.97), ii) DL with expert-recommended predictors (16 predictors, AUC = 0.96), iii) SVM with selected predictors (15 predictors, AUC = 0.92), iv) SVM with expert-recommended predictors (AUC = 0.89) and TIMI (AUC = 0.82). Common predictors across SVM feature selection, expert-recommendation and TIMI are: age, heart rate, Killip class, fasting blood glucose, systolic blood pressure, comorbid diseases and ST-elevation. SVM feature selection also identified diuretics, PCI and pharmacotherapy drugs as predictors that improve mortality prediction in STEMI patients. Our findings suggest that the TIMI score underestimates patients risk of mortality. DL algorithm using selected predictors classified 35% of nonsurvival patients as high risk (risk probabilities >50%) compared to only 12.7% nonsurvival patients by TIMI (score >5) (Figure below). Conclusions In the ASIAN population, patients with STEMI can be better classified using the DL algorithm compared to the ML and TIMI score. Combining ML feature selection with DL allows the identification of distinct factors in a unique ASIAN population for better mortality prediction than relying solely on an expert recommendation as it is a very subjective approach. Continuous validation on population-specific algorithms using DL and ML is needed before implementing in a real clinical setting. Funding Acknowledgement Type of funding sources: Public grant(s) – National budget only. Main funding source(s): Technology Development Fund 1 TIMI performance on validation set  DL performance on validation set