Abstract
The Vocabulary Size Test (VST) is one of the most commonly used assessment tools for measuring English vocabulary size in the field of language testing. Despite its common usage, only a limited number of validity and reliability studies were carried out for the VST. Besides, they were mostly predicated on the Rasch model. This validation study attempted to reveal evidence for construct validity for the VST, and for this purpose, item response theory (IRT) analyses were performed based on the three-parameter logistic model (3PLM). The assumptions of IRT were investigated via factor analysis (unidimensionality) and Yen’s Q3 statistic (local independence). To add evidence based on internal structure and to check fairness as lack of measurement bias, detailed differential item functioning (DIF) analyses were conducted with Mantel-Haenszel, Lord's chi-square test, and Logistic regression methods. The validation results with IRT showed that the 3PLM, which includes the guessing parameter, fitted the data better than the one and the two-parameter logistic models. DIF results indicated that 10 items exhibited large DIF (five favoring males and five favoring females). The results further showed that the guessing effect was not negligible for the VST.
Publisher
Egitimde ve Psikolojide Olcme ve Degerlendirme Dergisi
Subject
Developmental and Educational Psychology,Education
Reference57 articles.
1. Alderson, J. C. (2005). Diagnosing foreign language proficiency: The interface between learning and assessment. Continuum. https://doi.org/10.5040/9781474212151
2. American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (2014). Standards for educational and psychological testing. American Educational Research Association.
3. Aryadoust, V., Ng, L. Y., & Sayama, H. (2021). A comprehensive review of Rasch measurement in language assessment: Recommendations and guidelines for research. Language Testing, 38(1), 6–40. https://doi.org/10.1177/0265532220927487
4. Baker, F. (2001). The basics of Item response theory. ERIC Clearinghouse on Assessment and Evaluation.
5. Beglar, D. (2010). A Rasch-based validation of the vocabulary size test. Language Testing, 27(1), 101–118. https://doi.org/10.1177/0265532209340194
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献