Deep Learning Models Can Predict Violence and Threats Against Healthcare Providers Using Clinical Notes

Abstract

AbstractViolence, verbal abuse, threats, and sexual harassment of healthcare providers by patients is a major challenge for healthcare organizations around the world, contributing to staff turnover, distress, absenteeism, and reduced job satisfaction and overall mental and physical health. To enable interventions prior to possible violent episodes, we trained two deep learning models to predict violence against healthcare workers 3 days prior to violent events for case and control patients. The first model is a document classification model using clinical notes, and the second a baseline regression model using largely structured data. Our document classification model achieved an F1 score of 0.75 while our model using structured data achieved an F1 of 0.72, both exceeding predictive performance of a psychia-try team who reviewed the same documents (0.5 F1). To aid in explainability and understanding of risk factors for violent events, we additionally trained a named entity recognition classifier on annotations of the same corpus, which achieved an overall F1 of 0.7. This study demonstrates the first deep learning model capable of predicting violent events within healthcare settings using clinical notes, sur-passing the first published baseline of human experts. We anticipate our methods can be generalized and extended to enable intervention at other hospital systems.