How to estimate health service coverage in 58 districts of Benin with no survey data: Using hybrid estimation to fill the gaps

Abstract

The global movement to use routine information for managing health systems to achieve the Sustainable Development Goals, relies on administrative data which have inherent biases when used to estimate coverage with health services. Health policies and interventions planned with incorrect information can have detrimental impacts on communities. Statistical inferences using administrative data can be improved when they are combined with random probability survey data. Sometimes, survey data are only available for some districts. We present new methods for extending combined estimation techniques to all districts by combining additional data sources. Our study uses data from a probability survey (n = 1786) conducted during 2015 in 19 of Benin’s 77 communes and administrative count data from all of them for a national immunization day (n = 2,792,803). Communes are equivalent to districts. We extend combined-data estimation from 19 to 77 communes by estimating denominators using the survey data and then building a statistical model using population estimates from different sources to estimate denominators in adjacent districts. By dividing administrative numerators by the model-estimated denominators we obtain extrapolated hybrid prevalence estimates. Framing the problem in the Bayesian paradigm guarantees estimated prevalence rates fall within the appropriate ranges and conveniently incorporates a sensitivity analysis. Our new methodology, estimated Benin’s polio vaccination rates for 77 communes. We leveraged probability survey data from 19 communes to formulate estimates for the 58 communes with administrative data alone; polio vaccination coverage estimates in the 58 communes decreased to ranges consistent with those from the probability surveys (87%, standard deviation = 0.09) and more credible than the administrative estimates. Combining probability survey and administrative data can be extended beyond the districts in which both are collected to estimate coverage in an entire catchment area. These more accurate results will better inform health policy-making and intervention planning to reduce waste and improve health in communities.