Where There’s Smoke: Validating a Nonproprietary Single-Item Burnout-Impacting-Safety Scale

Abstract

This study aimed to assess the utility of a single survey item to predict the impact of burnout on safety and quality of healthcare providers as perceived by their colleagues. The primary objective is to determine if the item predicts the frequency of patient safety event reports within certain clinical departments. The secondary objective will be to determine if there is an acceptable cutoff score for the item which predicts low versus high numbers of safety events reported by healthcare providers in each clinical department. Participants were 424 healthcare providers in an academic medical center in the mid-Atlantic region of the United States. The item was designed to assess for the perception of the impact of burnout on work in terms of quality or safety using a 5-point Likert scale. Data from a patient safety event reporting system was accessed for the year of survey completion (2017). A negative binomial regression was used to assess the ability of the item to predict reported patient safety event reports. The item was found to significantly predict objective safety event data. Sensitivity and specificity, as well as receiver operating characteristic (ROC) curve analyses, were conducted to determine appropriateness of cutoff scores to identify low- and high-risk clinical departments. The item was found to demonstrate adequate sensitivity (82%) using a cutoff score of 4 on the survey item. However, the area under the curves (AUCs) which assess diagnostic accuracy fell in the poor range. These results suggest that healthcare administrators could deploy this single item as a brief pulse or screener of teams of individuals who are within a work unit and use a cutoff score of 4 as a means to assess for hot spots where healthcare provider burnout may be putting patients at high risk in terms of safety.