Using Confidence Intervals for Assessing Reliability of Real Tests-Reference-Cited by-同舟云学术

Using Confidence Intervals for Assessing Reliability of Real Tests

Published:2017-10-31 Issue:7 Volume:26 Page:1207-1216
ISSN:1073-1911
Container-title:Assessment
language:en
Short-container-title:Assessment

Author:

Oosterwijk Pieter R.¹,van der Ark L. Andries²,Sijtsma Klaas³

Affiliation:

1. Court of Audit, The Hague, Netherlands

2. University of Amsterdam, Amsterdam, Netherlands

3. Tilburg University, Tilburg, Netherlands

Abstract

Test authors report sample reliability values but rarely consider the sampling error and related confidence intervals. This study investigated the truth of this conjecture for 116 tests with 1,024 reliability estimates (105 pertaining to test batteries and 919 to tests measuring a single attribute) obtained from an online database. Based on 90% confidence intervals, approximately 20% of the initial quality assessments had to be downgraded. For 95% confidence intervals, the percentage was approximately 23%. The results demonstrated that reported reliability values cannot be trusted without considering their estimation precision.

Publisher

SAGE Publications

Subject

Applied Psychology,Clinical Psychology

Link

http://journals.sagepub.com/doi/pdf/10.1177/1073191117737375

Reference42 articles.

1. Alpha, Dimension-Free, and Model-Based Internal Consistency Reliability

2. Inequalities among lower bounds to reliability: With applications to test construction and factor analysis

Cited by 16 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Evidence of interrelated cognitive-like capabilities in large language models: Indications of artificial general intelligence or achievement?;Intelligence;2024-09

2. “We Can Do Better”: Developing Attitudinal Scales Relevant to LGBTQ2S+ Issues—A Primer on Best Practice Recommendations for Beginners in Scale Development;Behavioral Sciences;2024-07-18

3. How Reliable are Single-Question Workplace-Based Assessments in Surgery?;Journal of Surgical Education;2024-05

4. Choosing Between Cronbach’s Coefficient Alpha, McDonald’s Coefficient Omega, and Coefficient H : Confidence Intervals and the Advantages and Drawbacks of Interpretive Guidelines;Measurement and Evaluation in Counseling and Development;2024-02-22

5. Measurement Invariance of Scores on the Somatic Symptom Scale-8: National Sample of Non-Clinical Adults in the United States;Measurement and Evaluation in Counseling and Development;2023-09-12