Agree to agree: correcting acquiescence bias in the case of fully unbalanced scales with application to UK measurements of political beliefs

Abstract

AbstractA methodologically important area in political science is measuring the ideology of voters. This task can be difficult, and researchers often rely on ‘off the shelf’ datasets. Many of these datasets contain unbalanced Likert scales, which risk acquiescence bias. This paper proposes a strategy for dealing with this issue. I first demonstrate using two comparable datasets from the UK how unbalanced scales produce distorted distributions and can affect regression results. Then, building on past research that utilises factor analysis to eliminate the influence of acquiescence bias, I demonstrate how researchers can utilise a person intercept confirmatory factor analysis model to obtain factor scores corrected for acquiescence in the case of fully unbalanced scales. I conclude with practical recommendations for researchers and survey designers moving forward.