Affiliation:
1. Italian National Institute of Statistics (ISTAT) , Via Cesare Balbo 16, Rome, 00184 , Italy .
Abstract
Abstract
The mixed-mode (MM) designs are adopted by NSIs both to contrast declining response and coverage rates and to reduce the cost of the surveys. However, MM introduces several issues that must be addressed both at the design phase, by defining the best collection instruments to contain the measurement error, and at the estimation phase, by assessing and adjusting the mode effect. In the MM surveys, the mode effect refers to the introduction of bias effects on the estimate of the parameters of interest due to the difference in the selection and measurement errors specific to each mode. The switching of a survey from single to mixed-mode is a delicate operation: the accuracy of the estimates must be ensured in order to preserve their consistency and comparability over time. This work focuses on the methods chosen for the evaluation of the mode effect in the Italian National Institute of Statistics (ISTAT) mixed-mode survey “Aspects of Daily Life – 2017”, in the experimental context for which an independent control single-mode (SM) PAPI sample was planned to assess the introduction of the sequential web/PAPI survey. The presented methods aim to analyze the causes that can determine significant differences in the estimates obtained with the SM and MM surveys.
Reference22 articles.
1. Austin, P.C., and D.S. Small. 2014. “The use of bootstrapping when using propensity-score matching without replacement: a simulation study.” Statistics in Medicine 33(24) : 4306–4319. Wiley Online Library. DOI: https://doi.org/10.1002/sim.6276.
2. Ballabio, S., A. Carra, S. Casacci, D. Ferrazza, F. Verrecchia, A. Vitalini, and L.C. Viviano. 2018. “Local decisions and new guidelines of the Official Statistics.” In Proceedings of Q2018 European Conference on Quality in Official Statistics, June 2018, Cracovia, Poland.
3. Bethlehem, J., F. Cobben, and B. Schouten. 2011. Handbook of nonresponse in household surveys. Wiley Series in Survey Methodology. Hoboken, New Jersey: John Wiley & Sons, Inc. DOI: https://doi.org/10.1002/9780470891056.
4. Buelens, B., and J.A. van den Brakel. 2014. “Measurement error calibration in mixed-mode Sample Surveys.” Sociological methods and Research 44(3) : 391–426. DOI: https://doi.org/10.1177/0049124114532444.
5. Buelens, B., J.A. van den Brakel, and B. Schouten. 2018. “Current methodologies to deal with mode effects and mode bias in multi-mode designs.” MIMOD Deliverable 1 – WP2. Available at: https://www.istat.it/en/research-activity/international-research-activity/essnet-and-grants (accessed May 2021).