Affiliation:
1. Institut Teknologi Sepuluh Nopember, Surabaya 60111, Indonesia
2. Department of Computer Science and Information Technology, La Trobe University, Melbourne, VIC 3000, Australia
Abstract
Assessment is one benchmark in measuring students’ abilities. However, assessment results cannot necessarily be trusted, because students sometimes cheat or even guess in answering the questions. Therefore, to obtain valid results, it is necessary to separate valid and invalid answers by considering rapid-guessing behaviour. We conducted a test to record exam log data from undergraduate and postgraduate students to model rapid-guessing behaviour by determining the threshold response time. Rapid-guessing behaviour detection is inspired by the common k-second method. However, the method flattens the application of the threshold, thus allowing misclassification. The modified method considers item difficulty in determining the threshold. The evaluation results show that the system can identify students’ rapid-guessing behaviour with a success rate of 71%, which is superior to the previous method. We also analysed various aggregation techniques of response time and compared them to see the effect of selecting the aggregation technique.
Funder
Institut Teknologi Sepuluh Nopember
Reference21 articles.
1. (2017). Scottish Qualifications Authority Guide to Assessment, Scottish Qualifications Authority.
2. Kennedy, K.J., and Lee, J.C.K. (2007). The Changing Role of Schools in Asian Societies: Schools for the Knowledge Society, Routledge.
3. A fuzzy expert system-based adaptive learning approach to improving students’ learning performances by considering affective and cognitive factors;Hwang;Comput. Educ. Artif. Intell.,2020
4. A conceptual map model for developing intelligent tutoring systems;Hwang;Comput. Educ.,2003
5. Peng, S.S., and Lee, C.K.J. (2009). Educational Evaluation in East Asia: Emerging Issues and Challenges, Nova Science Publishers.
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献