Assessing targeted invitation and response modes to improve survey participation in a diverse New York City panel: Healthy NYC

Abstract

Background Healthy NYC is an innovative survey panel created by the New York City (NYC) Department of Health and Mental Hygiene (DOHMH) that offers a cost-effective mechanism for collecting priority and timely health information. Between November 2020 and June 2021, invitations for six different surveys were sent to Healthy NYC panelists by postal mail, email, and text messages. Panelists had the option to complete surveys online or via paper survey. Methods We analyzed whether panelists varied by sociodemographic characteristics based on the contact mode they provided and the type of invitation that led to their response using logistic regression models. Poisson regression models were used to determine whether the number of invitations received before participating in a survey was associated with sociodemographic characteristics. Results Younger age and higher education were positively associated with providing an email or text contact. Furthermore, age, race, and income were significant predictors for invitation modes that led to a survey response. Black panelists had 72% greater odds (OR 1.72 95% CI: 1.11–2.68) of responding to a mail invite and 33% lesser odds (OR 0.67, 95% CI: 0.54–0.83) of responding to an email invite compared with White panelists. Additionally, in five of the six surveys, more than half of the respondents completed surveys after two invites. Email invitations garnered the highest participation rates. Conclusions We recommend using targeted invitation modes as an additional strategy to improve participation in panels. For lower-income panelists who do not provide an email address, it may be reasonable to offer additional response options that do not require internet access. Our study’s findings provide insight into how panels can tailor outreach to panelists, especially among underrepresented groups, in the most economical and efficient ways.