A New Risk Model based on the Machine Learning Approach for Prediction of Mortality in the Respiratory Intensive Care Unit

Abstract

Background: Intensive care unit (ICU) resources are inadequate for the large population in China, so it is essential for physicians to evaluate the condition of patients at admission. In this study, our objective was to construct a machine-learning risk prediction model for mortality in respiratory intensive care units (RICUs). Methods: This study involved 817 patients who made 1,063 visits and who were admitted to the RICU from 2012 to 2017. Potential predictors such as demographic information, laboratory results, vital signs and clinical characteristics were considered. We constructed eXtreme Gradient Boosting (XGBoost) models and compared performances with random forest models, logistic regression models and clinical scores such as Acute Physiology and Chronic Health Evaluation II (APACHE II) and the sequential organ failure assessment (SOFA) system. The model was externally validated using data from Medical Information Mart for Intensive Care (MIMIC-III) database. A web-based calculator was developed for practical use. Results: Among the 1,063 visits, the RICU mortality rate was 13.5%. The XGBoost model achieved the best performance with the area under the receiver operating characteristics curve (AUROC) of 0.860 (95% confidence interval (CI): 0.808 - 0.909) in the test set, which was significantly greater than APACHE II (0.749, 95% CI: 0.674 - 0.820; P = 0.015) and SOFA (0.751, 95% CI: 0.669 - 0.818; P = 0.018). The Hosmer-Lemeshow test indicated a good calibration of our predictive model in the test set with a P-value of 0.176. In the external validation dataset, the AUROC of XGBoost model was 0.779 (95% CI: 0.714 - 0.813). The final model contained variables that were previously known to be associated with mortality, but it also included some features absent from the clinical scores. The mean N-terminal pro-B-type natriuretic peptide (NTproBNP) of survivors was significantly lower than that of the non-survival group (2066.43 pg/mL vs. 8232.81 pg/mL; P < 0.001). Conclusions: Our results showed that the XGBoost model could be a suitable model for predicting RICU mortality with easy-to-collect variables at admission and help intensivists improve clinical decision-making for RICU patients. We found that higher NT-proBNP can be a good indicator of poor prognosis.