Developing Reliable Measures

Author:

Alwin Duane F.

Abstract

This chapter presents a general approach to assessing the reliability of measurement of survey questions—those in common use in many surveys. The approach, which relies on a robust set of longitudinal design requirements, applies the quasi-Markov simplex model to multi-wave data in the evaluation of measurement errors for survey questions. Under particular assumptions, this model produces a set of estimates that conform to the psychometric definition of measurement reliability, defined as the ratio of true variance to observed variance. These models attribute some of the over-time inconsistency in measurements to unreliability and some to true change. This strategy rejects traditional notions of reliability that rely on internal consistency estimates for composite variables, as well as the simple test–retest approach to estimating reliability. Rather, the emphasis is on the separation of unreliability from true change in observations made over time. The importance of meeting several design requirements for using these over-time statistical models is also emphasized. These include the use of large-scale panel studies representative of known populations, with a minimum of three waves of measurement, separated by lengthy re-interview intervals, and limited to exactly replicated questions over the multiple waves. Results are presented from several three-wave panel studies that have employed this design, which provide evidence for the utility of the approach in the evaluation of the quality of survey measurement with respect to question content, context, and form.

Publisher

Oxford University Press

Cited by 4 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3