Affiliation:
1. Agricultural Education and Extension, Botswana University of Agriculture and Natural Resources
2. Department of Educational Foundations University of Cape Coast, Ghana
3. Department of Educational Foundations, University of Cape Coast, Ghana
Abstract
This study aimed to assess the psychometric properties of the Junior Certificate Examination (JCE) agricultural science multiple-choice items in Botswana, using the 3-parameter logistic model (3PLM). Adopting a quantitative descriptive research design, the study analyzed responses from 40,343 examinees who took the 40 multiple-choice items in the 2018 JCE agricultural science examination. The study utilized secondary data from Botswana Examination Council (BEC) records. They also obtained the ethical clearance from the Institutional Review Board of the University Cape Coast. The analysis, conducted using 3PLM within the R-studio environment revealed that 15% of items exhibited poor discrimination indices, 10% had difficulty and 12.5% were prone to guessing. There was an identification of Key anomalies in specific items, warranting careful consideration. Approximately 90% of the multiple-choice items fell within the good difficulty level range but 10% appeared to be poor difficulty. For item discrimination, up to 85% were within the acceptable range while 15% were outside. The study recommends a thorough revision or removal of items with poor parameter estimates, emphasizing continuous monitoring and collaboration between the Ministry of Basic Education and test constructors for ongoing improvement. Additionally, the study recommends stringent review of items with extreme difficulty indices to maintain a balanced assessment.
Publisher
Gitoya Centre for Academic Research and Dissemination
Reference33 articles.
1. Akanwa, U. N., Ihechu, K. J. P., & Nkwocha, P. C. (2020). Effect of language manipulation on differential item functioning of agricultural science multiple choice test items. Journal Of The Nigerian Academy Of Education, 14(1), 211-223.
2. Ayanwale, M. A. (2019). Efficacy of item response theory in the validation and score ranking of dichotomous and polytomous response mathematics achievement tests in Osun State, Nigeria. (Doctoral dissertation, University of Ibadan).
3. Ayanwale, M. A., Adeleke, J. O., & Mamadelo, T. I. (2018). An assessment of item statistics estimates of basic education certificate examination through classical test theory and item response theory approach. International Journal of Educational Research Review, 3(4), 55-67.
4. Asuquo, U. M., Ekon, J. S., & Chigbu, N. N. (2022). Guessing parameters and multiple-choice test items of 2016 - 2017 National Examination Council (NECO) Mathematics Examination Instruments in Calabar Education Zone of Cross River State. J Adv Educ Philos, 6(9), 492-497.
5. Baker, F. B. (2001). The basics of item response theory. http://ericae. net/irt/baker.