Machine Learning Model of Emergency Department Use for Patients Undergoing Treatment for Head and Neck Cancer Using Comprehensive Multifactor Electronic Health Records

Abstract

PURPOSE To use a hybrid method, combining statistical profiling, machine learning (ML), and clinical evaluation to predict emergency department (ED) visits among patients with head and neck cancer undergoing radiotherapy. MATERIALS AND METHODS Patients with head and neck cancer treated with radiation therapy from 2015 to 2019 were identified using electronic health record data. Records from 60 days before 90 days after treatment were analyzed. Statistical profiling and ML were used to create a predictive model for ED visits during or after radiation therapy. A comprehensive set of variables were studied. Multiple ML models were developed including extreme gradient-boosted decision tree and generalized logistic regression with comparison of multiple predictive performance metrics. RESULTS Of the 1,355 patients studied, 13% had an ED visit during or after treatment. Our hybrid methodology enabled evidence-based winnowing of candidate features from 141 to 11 with clinically applicable, evidence-based thresholds. Extreme gradient boosting had the highest area under the curve (0.81 ± 0.06) with a sensitivity of 0.89 ± 0.10 and exceeded generalized logistic regression (area under the curve 0.64 ± 0.02). Significant predictors of ED visits during treatment included increasingly complex opioid use, number of prior ED visits, tumor volume, rate of change of blood urea nitrogen, total bilirubin, body mass index, and distance from hospital. CONCLUSION Our approach combining bootstrapped statistical profiling and ML importance analysis supported integration of clinician input to identify a distilled set of phenotypical characteristics for developing ML models predicting which patients undergoing head and neck cancer radiation therapy were at risk for ED visits.