How can patient experience scores be used to predict quality inspection ratings? A retrospective cross-sectional study of national primary care datasets in the UK

Abstract

ObjectivesThe relationship between patient feedback in the General Practice Patient Survey (GPPS) and Care Quality Commission (CQC) inspections of practices was investigated to understand whether there is an association between patient views and regulator ratings of quality. The specific aims were to understand whether patients’ self-reported experiences of primary care can predict CQC inspection ratings of GP practices by: (i) Measuring the association between GPPS results and CQC inspection ratings of GP practices; (ii) Building a predictive model of GP practice quality ratings that use GPPS results; and (iii) Evaluating the predictive model for risk stratification.DesignRetrospective analysis of routinely collected data using decision tree modelling.SettingPrimary care: GP practices in England.Primary and secondary outcome measuresGPPS scores and GP practice CQC inspection ratings during 2018.ResultsMost GP practices (72%, 974/1350) were rated as ‘Good’ overall by CQC. Simply assuming that all practices will be rated as ‘Good’ results in a correct prediction 72% of the time, and it was not possible to improve on this overall level of predictive accuracy using decision tree modelling (correct in 73% of cases). However, a set of GPPS questions were found to have value in identifying practices at elevated risk of a poor inspection rating.ConclusionsAlthough there were some associations between GPPS data and CQC inspection ratings, there were limitations to the use of GPPS data for predictive analysis. This is a likely result of the majority of CQC inspections of GPs resulting in a ‘Good’ or ‘Outstanding’ rating. However, some GPPS questions were found to have value in identifying practices at higher risk of an ‘Inadequate’ or ‘Requires Improvement’ rating, and this may be valuable for surveillance purposes. For example, the CQC could use key questions from the survey to target inspection planning.