Machine Learning–Based Profiling in Test Cheating Detection

Abstract

AbstractIn recent years, machine learning (ML) techniques have received more attention in detecting aberrant test‐taking behaviors due to advantages when compared to traditional data forensics methods. However, defining “True Test Cheaters” is challenging—different than other fraud detection tasks such as flagging forged bank checks or credit card frauds, testing organizations are often lack of physical evidences to identify “True Test Cheaters” to train ML models. This study proposed a statistically defensible method of labeling “True Test Cheaters” in the data, demonstrated the effectiveness of using ML approaches to identify irregular statistical patterns in exam data, and established an analytical framework for evaluating and conducting real‐time ML‐based test data forensics. Classification accuracy and false negative/positive results are evaluated across different supervised‐ML techniques. The reliability and feasibility of operationally using this approach for an IT certification exam are evaluated using real data.