A Comparison of Value-Weight-Elicitation Methods for Accurate and Accessible Participatory Planning

Abstract

This research analyzed six value-weight-elicitation techniques that are commonly used in participatory planning. It compared the techniques via measures of (1) accuracy (within-subjects user-derived assessments and quantitative weight comparisons) and (2) accessibility (time to complete, difficulty, and “boringness”). Visual sliders performed best across assessments. Pairwise comparison, visual sliders, and swing weighting were the most accurate, while visual sliders and vertical visual scale were the most accessible. Point allocation and the popular Likert-type method performed poorly across assessments. All methods produced similar weights, highlighting the importance of accessibility when choosing scales. This research can inform participatory planning and survey design techniques.