Forecasting disease trajectories in critical illness: comparison of probabilistic dynamic systems to static models to predict patient status in the intensive care unit

Abstract

ObjectiveConventional prediction models fail to integrate the constantly evolving nature of critical illness. Alternative modelling approaches to study dynamic changes in critical illness progression are needed. We compare static risk prediction models to dynamic probabilistic models in early critical illness.DesignWe developed models to simulate disease trajectories of critically ill COVID-19 patients across different disease states. Eighty per cent of cases were randomly assigned to a training and 20% of the cases were used as a validation cohort. Conventional risk prediction models were developed to analyse different disease states for critically ill patients for the first 7 days of intensive care unit (ICU) stay. Daily disease state transitions were modelled using a series of multivariable, multinomial logistic regression models. A probabilistic dynamic systems modelling approach was used to predict disease trajectory over the first 7 days of an ICU admission. Forecast accuracy was assessed and simulated patient clinical trajectories were developed through our algorithm.Setting and participantsWe retrospectively studied patients admitted to a Cleveland Clinic Healthcare System in Ohio, for the treatment of COVID-19 from March 2020 to December 2022.Results5241 patients were included in the analysis. For ICU days 2–7, the static (conventional) modelling approach, the accuracy of the models steadily decreased as a function of time, with area under the curve (AUC) for each health state below 0.8. But the dynamic forecasting approach improved its ability to predict as a function of time. AUC for the dynamic forecasting approach were all above 0.90 for ICU days 4–7 for all states.ConclusionWe demonstrated that modelling critical care outcomes as a dynamic system improved the forecasting accuracy of the disease state. Our model accurately identified different disease conditions and trajectories, with a <10% misclassification rate over the first week of critical illness.