Affiliation:
1. Center for Economic and Social Research , University of Southern California , 635 Downey Way VPD, Los Angeles, 90089 California , U.S.A.
Abstract
Abstract
We conducted an idiographic analysis to examine the effect of survey burden, measured by the length of the most recent questionnaire, or number of survey invitations (survey frequency) in a one-year period preceding a new survey, on the response probability to a new survey in a probability-based Internet panel. The individual response process was modeled by a latent Markov chain with questionnaire length and survey frequency as explanatory variables. The individual estimates were obtained using a Monte Carlo based method and then pooled to derive estimates of the overall relationships and to identify specific subgroups whose responses were more likely to be impacted by questionnaire length or survey frequency. The results show an overall positive relationship between questionnaire length and response probability, and no significant relationship between survey frequency and response probability. Further analysis showed that longer questionnaires were more likely to be associated with decreased response rates among racial/ethnic minorities and introverted participants. Frequent surveys were more likely to be associated with decreased response rates among participants with a large household. We discuss the implications for panel management and advocate targeted interventions for the small subgroups whose response probability may be negatively impacted by longer questionnaires or frequent surveys.
Reference53 articles.
1. Andrieu, C., A. Doucet, and R. Holenstein. 2010. “Particle Markov Chain Monte Carlo Methods.” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 72 (3): 269–342. DOI: https://doi.org/10.1111/j.1467-9868.2009.00736.x.
2. Baker, R., S.J. Blumberg, J.M. Brick, M.P. Couper, M. Courtright, J.M. Dennis, D. Dillman, M.R. Frankel, and P.Garland. 2010. “AAPOR Report on Online Panels.” Public Opinion Quarterly 74 (4): 711–781. DOI: https://doi.org/10.1093/poq/nfq048.
3. Bartolucci, F., A. Farcomeni, and F. Pennoni. 2019. Latent Markov Models for Longitudinal Data. Boca Raton, FL: Chapman and Hall/CRC.
4. Blumenberg, C., A.M.B. Menezes, H. Gonçalves, M.C. Formoso Assunção, F.C. Wehrmeister, F.C. Barros, and A.J.D. Barros. 2019. “The Role of Questionnaire Length and Reminders Frequency on Response Rates to a Web-Based Epidemiologic Study: A Randomised Trial.” International Journal of Social Research Methodology 22 (6): 625–35. DOI: https://doi.org/10.1080/13645579.2019.1629755.
5. Bradburn, N. 1978. “Respondent Burden.” In Proceedings of the Survey Research Methods Section of the American Statistical Association, 35: 35–40. Alexandria, VA: American Statistical Association. Available at: http://www.asasrms.org/Proceedings/y1978f.html (accessed August 2021).