Development of a Clinical Decision Support System for Severity Risk Prediction and Triage of COVID-19 Patients at Hospital Admission: an International Multicenter Study

Abstract

BackgroundThe outbreak of the coronavirus disease 2019 (COVID-19) has globally strained medical resources and caused significant mortality.ObjectiveTo develop and validate machine-learning model based on clinical features for severity risk assessment and triage for COVID-19 patients at hospital admission.Method725 patients were used to train and validate the model including a retrospective cohort of 299 hospitalised COVID-19 patients at Wuhan, China, from December 23, 2019, to February 13, 2020, and five cohorts with 426 patients from eight centers in China, Italy, and Belgium, from February 20, 2020, to March 21, 2020. The main outcome was the onset of severe or critical illness during hospitalisation. Model performances were quantified using the area under the receiver operating characteristic curve (AUC) and metrics derived from the confusion-matrix.ResultsThe median age was 50.0 years and 137 (45.8%) were men in the retrospective cohort. The median age was 62.0 years and 236 (55.4%) were men in five cohorts. The model was prospectively validated on five cohorts yielding AUCs ranging from 0.84 to 0.89, with accuracies ranging from 74.4% to 87.5%, sensitivities ranging from 75.0% to 96.9%, and specificities ranging from 57.5% to 88.0%, all of which performed better than the pneumonia severity index. The cut-off values of the low, medium, and high-risk probabilities were 0.21 and 0.80. The online-calculators can be found at www.covid19risk.ai.ConclusionThe machine-learning model, nomogram, and online-calculator might be useful to access the onset of severe and critical illness among COVID-19 patients and triage at hospital admission.