A pilot study examining the impact of a pragmatic process for improving the cultural responsiveness of non-Aboriginal alcohol and other drug treatment services using routinely collected data in Australia

Abstract

Objective: Routine health data has the potential to identify changes in patient-related outcomes, in close to real time. This pilot project used routine data to explore and compare the impact of changes to cultural responsiveness on service use by Aboriginal and Torres Strait Islander (hereafter, Aboriginal) clients in Australia.Methods: The New South Wales Minimum Data Set (MDS) for alcohol and other drug use treatment services was provided for 11 services for a period of 30 months from March 2019 to September 2021 (four months prior to two years after the intervention; data were analysed between March 2022 to February 2023). Change in cultural responsiveness was assessed via practice audits of services at baseline and two years. The average change in audit rating was analysed using a linear mixed regression model. Generalised Linear Mixed Models were used to identify changes in service use by Aboriginal clients. Results: All 11 services showed increased audit scores at two years, with a statistically significant mean increase of 18.6 (out of 63 points; b = 18.32, 95% CI 12.42-24.22). No statistically significant pre-to post-changes were identified in: (1) the proportion of episodes delivered to Aboriginal versus non-Aboriginal clients (OR = 1.15, 95% CI = 0.94-1.40), (2) the number of episodes of care provided to Aboriginal clients per month (IRR = 1.01, 95% CI = 0.84-1.23), or (3) the proportion of episodes completed by Aboriginal clients (OR = 0.96, 95% CI = 0.82-1.13). Conclusions: The lack of statistically significant impact on service use outcomes using MDS contrasts to the improvements in cultural responsiveness, suggesting further work is needed to identify appropriate outcome measures. This may include patient-reported experience measures. This project showed that routine data has potential as an efficient method for measuring changes in patient-related outcomes in response to health services improvements.