Affiliation:
1. GESIS Leibniz Institute for the Social Sciences, Mannheim, Germany.
Abstract
Self-administered mixed-mode surveys are increasingly used as an alternative to face-to-face surveys for collecting data from the general population. However, little is known about how decisions regarding the incentive scheme and the mode-choice design jointly affect key outcomes such as response rates, net sample composition, and survey costs. To study this, we drew a probability sample of the residential population of the city of Mannheim, Germany ( N = 2,980) and randomly assigned target persons to one of four incentive schemes (€0, €1, or €2 prepaid incentive on first contact, and €2 delayed prepaid incentive) and one of two mode-choice designs (concurrent or sequential [web-push]). Our results indicate that small prepaid monetary incentives work better in concurrent than in sequential designs. Moreover, a €2 prepaid incentive in a concurrent design proved particularly successful for older target persons, probably reinforcing their sense of trust and reciprocity, while also fitting better with their survey-mode preferences. Finally, a €2 delayed prepaid incentive in a sequential design primarily motivated target persons aged under 50 years. This combination of incentive scheme and mode-choice design also proved to be most cost-effective in that age group. Based on our results, we recommend using sampling frame information on age to address different age groups with different combinations of incentive scheme and mode-choice design. This may help to maximize response rates, achieve a balanced net sample composition, and minimize survey costs.
Subject
Sociology and Political Science
Reference39 articles.
1. American Association for Public Opinion Research (AAPOR) (2016) Standard definitions: Final dispositions of case codes and outcome rates for surveys. Available at: https://aapor.org/wp-content/uploads/2022/11/Standard-Definitions20169theditionfinal.pdf.
2. The Effectiveness of Mailed Invitations for Web Surveys and the Representativeness of Mixed-Mode versus Internet-only Samples
3. Are Prepaid Monetary Incentives Sufficient for Reducing Panel Attrition and Optimizing the Response Rate? An Experiment in the Context of a Multi-Wave Panel with a Sequential Mixed-Mode Design
4. Beullens K, Loosveldt G, Vandenplas C, Stoop I (2018) Response rates in the European Social Survey: Increasing, decreasing, or a matter of fieldwork efforts? Survey Methods: Insights from the Field. Available at: https://surveyinsights.org/?p=9673. https://doi.org/10.13094/SMIF-2018-00003.
5. Using Bonus Monetary Incentives to Encourage Web Response in Mixed-Mode Household Surveys