Identifying children at high risk for infection-related decompensation using a predictive emergency department-based electronic assessment tool

Abstract

Abstract Objectives Electronic alert systems to identify potential sepsis in children presenting to the emergency department (ED) often either alert too frequently or fail to detect earlier stages of decompensation where timely treatment might prevent serious outcomes. Methods We created a predictive tool that continuously monitors our hospital’s electronic health record during ED visits. The tool incorporates new standards for normal/abnormal vital signs based on data from ∼1.2 million children at 169 hospitals. Eighty-two gold standard (GS) sepsis cases arising within 48 h were identified through retrospective chart review of cases sampled from 35,586 ED visits during 2012 and 2014–2015. An additional 1,027 cases with high severity of illness (SOI) based on 3 M’s All Patient Refined – Diagnosis-Related Groups (APR-DRG) were identified from these and 26,026 additional visits during 2017. An iterative process assigned weights to main factors and interactions significantly associated with GS cases, creating an overall “score” that maximized the sensitivity for GS cases and positive predictive value for high SOI outcomes. Results Tool implementation began August 2017; subsequent improvements resulted in 77% sensitivity for identifying GS sepsis within 48 h, 22.5% positive predictive value for major/extreme SOI outcomes, and 2% overall firing rate of ED patients. The incidence of high-severity outcomes increased rapidly with tool score. Admitted alert positive patients were hospitalized nearly twice as long as alert negative patients. Conclusions Our ED-based electronic tool combines high sensitivity in predicting GS sepsis, high predictive value for physiologic decompensation, and a low firing rate. The tool can help optimize critical treatments for these high-risk children.