Abstract
The purpose of this study is to examine the effect of different item selection methods on test information function (TIF) and test efficiency in computer adaptive testing (CAT). TIF indicates the quantity of information the test has produced. Test efficiency resembles the amount of information from each item, and more efficient tests are produced from the smallest number of good-quality items. The study was conducted with simulated data, and the constants of the study are sample size, ability parameter distribution, item pool size, model of item response theory (IRT) and distribution of item parameters, ability estimation method, starting rule, item exposure control and stopping rule. The item selection methods, which are the independent variables of this study, are the interval information criterion, efficiency balanced information, matching -b value, Kullback-Leibler information, maximum fisher information, likelihood-weighted information, and random selection. In the comparison of these methods, the best performance in the aspect of TIF is provided by the maximum fisher information method. In terms of test efficiency, the performances of the methods were similar, except for the random selection method, which had the worst performance in terms of both TIF and test efficiency.
Publisher
Egitimde ve Psikolojide Olcme ve Degerlendirme Dergisi
Subject
Developmental and Educational Psychology,Education
Reference61 articles.
1. Babcock, B. & Albano, A. D. (2012). Rasch scale stability in the presence of item parameter and trait drift. Applied Psychological Measurement, 36(7), 565- 580. https://doi.org/10.1177/0146621612455090
2. Babcock, B. & Weiss, D.J. (2012). Termination criteria in computerized adaptive tests: Do variable-length CAT’s provide efficient and effective measurement? International Association for Computerized Adaptive Testing, 1, 1-18. http://dx.doi.org/10.7333%2Fjcat.v1i1.16
3. Baker, F. (1986). The basics of item response theory. Journal of Educational Measurement, 23(3), 267-270.
4. Baker, F. B. (1992). Item response theory: Parameter estimation techniques. Marcel Dekker.
5. Balta, E., & Uçar, A. (2022). Investigation of measurement precision and test length in computerized adaptive testing under different conditions, E-International Journal of Educational Research, 13(1), 51-68. https://doi.org/10.19160/e-ijer.1023098