Affiliation:
1. Mail Stop 02-T, Educational Testing Service, Princeton NJ 08541, U.S.A.
2. Department of Statistics, Rutgers University, Hill Center, Busch Campus, New Brunswick NJ 08903, U. S. A.
Abstract
Most item selection in computerized adaptive testing is based on Fisher information (or item information). At each stage, an item is selected to maximize the Fisher information at the currently estimated trait level (θ). However, this application of Fisher information could be much less efficient than assumed if the estimators are not close to the true θ, especially at early stages of an adaptive test when the test length (number of items) is too short to provide an accurate estimate for true θ. It is argued here that selection procedures based on global information should be used, at least at early stages of a test when θ estimates are not likely to be close to the true θ. For this purpose, an item selection procedure based on average global information is proposed. Re sults from pilot simulation studies comparing the usual maximum item information item selection with the pro posed global information approach are reported, indicat ing that the new method leads to improvement in terms of bias and mean squared error reduction under many circumstances. Index terms: computerized adaptive testing, Fisher information, global information, infor mation surface, item information, item response theory, Kullback-Leibler information, local information, test in formation.
Subject
Psychology (miscellaneous),Social Sciences (miscellaneous)
Cited by
229 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. SACAT: Student-Adaptive Computerized Adaptive Testing;The Fifth International Conference on Distributed Artificial Intelligence;2023-11-30
2. Developing Computerized Adaptive Testing for a National Health Professionals Exam: An Attempt from Psychometric Simulations;Perspectives on Medical Education;2023-10-31
3. Addressing Selection Bias in Computerized Adaptive Testing: A User-Wise Aggregate Influence Function Approach;Proceedings of the 32nd ACM International Conference on Information and Knowledge Management;2023-10-21
4. Simulating Student Interactions with Two-stage Imitation Learning for Intelligent Educational Systems;Proceedings of the 32nd ACM International Conference on Information and Knowledge Management;2023-10-21
5. Search-Efficient Computerized Adaptive Testing;Proceedings of the 32nd ACM International Conference on Information and Knowledge Management;2023-10-21