Affiliation:
1. UIN Kiai Haji Achmad Siddiq Jember, Jawa Timur, INDONESIA
Abstract
This study aims to determine the validity, reliability, level of difficulty, and discrimination power of an artificial intelligence (AI)-generated collection of biology questions for higher education. Students’ responses to AI-generated questions are also presented in this study. A sample of 272 students was selected using a random sampling technique to answer a series of multiple-choice questions and complete a questionnaire. Based on the research findings, 20 of the 21 questions generated by ChatGPT AI are valid. Cronbach’s alpha coefficient was determined to be 0.65 (fairly reliable) for the twenty valid questions. Based on student responses to questions generated by ChatGPT’s AI, it was determined that 79% of students indicated that the AI-generated questions were relevant to the class subject. 72% of students reported that the clarity of AI-generated questions was acceptable. 73% of students reported that the accuracy of AI-generated questions was good.
Reference31 articles.
1. Arulogun, O. T., Akande, O. N. Akindele, A. T., & Badmus, T. A. (2020). Survey dataset on open and distance learning students’ intention to use social media and emerging technologies for online facilitation. Data in Brief, 31, 105929. https://doi.org/10.1016/j.dib.2020.105929
2. ChatGPT. (2023). ChatGPT. https://chat.openai.com/chat
3. Chauhan, P. R., Ratrhod, S. P., Chauhan, B. R., Chauhan, G. R., Adhvaryu, A., & Chauhan, A. P. (2013). Study of difficulty level and discriminating index of stem type multiple choice questions of anatomy in Rajkot. Biomirror, 4(6), 1-4.
4. Cho, K., Schunn, C. D., & Wilson, R. W. (2006). Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology, 98(4), 891-901. https://doi.org/10.1037/0022-0663.98.4.891
5. Considine, J., Botti, M., & Thomas, S. (2005). Design, format, validity and reliability of multiple choice questions for use in nursing research and education. Collegian, 12(1), 19-24. https://doi.org/10.1016/S1322-7696(08)60478-3
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献