Author:
Wu Rui,Gao Xuliang,Pan Shiquan,Wang Fan,Zhao Shouying
Abstract
AbstractThe homogeneity hypothesis is a common assumption in classic measurement. However, the item response theory model assumes that different respondents with same ability have the same option probabilities, which may not hold. The aim of this study is to propose a new individual random effect model that accounts for the differences in option probabilities among respondents with same latent traits by using within-person variance. The performance of the new model is evaluated through simulation studies and real data using the PRESUPP scale of PISA. The model parameters are estimated by the MCMC method. The results show that the individual random effect model can provide more accurate parameter estimates and obtain a scale parameter to describe the distribution of respondents’ abilities, under different within-person variances. The new model has lower RMSE and better model fit than the classic IRT model.
Publisher
Springer Science and Business Media LLC
Reference41 articles.
1. Jia, X. The defect of latent variable measurement by using true score model and reliability improvement——Taking customer satisfaction measurement as an example. Chin. J. Manag. 12(11), 1665–1670 (2015).
2. Lord, F. M., Novick, M. R. & Birnbaum, A. Statistical Theories of Mental Test Scores (Addison-Wesley, 1968).
3. Osterlind, S. J. & Everson, H. T. Differential Item Functioning (Sage Publications, 2009).
4. Henninger, M. & Meiser, T. Different approaches to modeling response styles in divide-by-total item response theory models (part 1): A model integration. Psychol. Methods 25(5), 560–576. https://doi.org/10.1037/met0000249 (2020).
5. Meiser, T., Plieninger, H. & Henninger, M. IRTree models with ordinal and multidimensional decision nodes for response styles and trait-based rating responses. Br. J. Math. Stat. Psychol. 72(3), 501–516. https://doi.org/10.1111/bmsp.12158 (2019).