Estimating Vaccine Effectiveness by Linking Population-Based Health Registries: Some Sources of Bias

Abstract

Abstract The coronavirus disease 2019 (COVID-19) pandemic has underscored the importance of observational studies of real-world vaccine effectiveness (VE) to help answer urgent public health questions. One approach to rapidly answering questions about real-world VE relies on linking data from a population-based registry of vaccinations with a population-based registry of health outcomes. Here we consider some potential sources of bias in linked registry studies, including incomplete reporting to the registries, errors in linking individuals between registries, and errors in the assumed population size of the catchment area of the registries. We show that the direction of the bias resulting from one source of error by itself is predictable. However, if multiple sources of error are present, the direction of the bias can be either upward or downward. The biases can be so strong as to make harmful vaccines appear effective. We provide explicit formulas with which to quantify and adjust for multiple biases in estimates of VE which could be used in sensitivity analyses. While this work was motivated by COVID-19 vaccine questions, the results are generally applicable to studies that link population-based exposure registries with population-based case registries to estimate relative risks of exposures.