Triage in major incidents: development and external validation of novel machine learning-derived primary and secondary triage tools

Abstract

BackgroundMajor incidents (MIs) are an important cause of death and disability. Triage tools are crucial to identifying priority 1 (P1) patients—those needing time-critical, life-saving interventions. Existing expert opinion-derived tools have limited evidence supporting their use. This study employs machine learning (ML) to develop and validate models for novel primary and secondary triage tools.MethodsAdults (16+ years) from the UK Trauma Audit and Research Network (TARN) registry (January 2008–December 2017) served as surrogates for MI victims, with P1 patients identified using predefined criteria. The TARN database was split chronologically into model training and testing (70:30) datasets. Input variables included physiological parameters, age, mechanism and anatomical location of injury. Random forest, extreme gradient boosted tree, logistic regression and decision tree models were trained to predict P1 status, and compared with existing tools (Battlefield Casualty Drills (BCD) Triage Sieve, CareFlight, Modified Physiological Triage Tool, MPTT-24, MSTART, National Ambulance Resilience Unit Triage Sieve and RAMP). Primary and secondary candidate models were selected; the latter was externally validated on patients from the UK military’s Joint Theatre Trauma Registry (JTTR).ResultsModels were internally tested in 57 979 TARN patients. The best existing tool was the BCD Triage Sieve (sensitivity 68.2%, area under the receiver operating curve (AUC) 0.688). Inability to breathe spontaneously, presence of chest injury and mental status were most predictive of P1 status. A decision tree model including these three variables exhibited the best test characteristics (sensitivity 73.0%, AUC 0.782), forming the candidate primary tool. The proposed secondary tool (sensitivity 77.9%, AUC 0.817), applicable via a portable device, includes a fourth variable (injury mechanism). This performed favourably on external validation (sensitivity of 97.6%, AUC 0.778) in 5956 JTTR patients.ConclusionNovel triage tools developed using ML outperform existing tools in a nationally representative trauma population. The proposed primary tool requires external validation prior to consideration for practical use. The secondary tool demonstrates good external validity and may be used to support decision-making by healthcare workers responding to MIs.