Measuring practice preference variation for quality improvement: development of the Neonatology Survey of Interdisciplinary Groups in Healthcare Tool (NSIGHT)

Abstract

BackgroundUnderstanding behavioural psychology and the human side of change are guiding principles for quality improvement (QI). Tools to measure these to guide improvement efforts are lacking.MethodsWe created a clinical vignette-based survey to measure provider preferences for respiratory care in the neonatal intensive care unit. Fourteen vignettes were included, each vignette offering two reasonable practice choices. Responses were based on a 5-point Likert scale, ranging from neutral to strong preference for either choice. The survey was completed by physicians, nurses, advanced practice providers and respiratory therapists in 2017 and again in 2019. Net preference was measured as the median value of responses, and agreement was measured as the SD of responses. Net preference and agreement were assessed for all responses, by discipline, and by year.ResultsResponse rates were 51% of all staff in 2017 and 57% in 2019. Vignettes asking about non-invasive respiratory support showed more defined net preferences and higher agreement between years, coinciding with QI efforts and guideline implementation in this area during the interval time. Results on other areas of practice were consistent between years. Discipline comparisons showed nurses and physicians agreed the least often. Six response patterns were identified, ranging from net preference and high agreement to no net preference and low agreement.ConclusionWe propose this survey, called the Neonatology Survey of Interdisciplinary Groups in Healthcare Tool, is a novel method for measurement of hospital unit psychology and culture. Demonstrated improvement where QI efforts were focused and consistency in results in other areas support the validity of this tool. Measuring the human side of change may impact QI efforts.