Determinants of student performance with mobile‐based assessment systems for English as a foreign language courses

Abstract

AbstractBackgroundMobile‐based assessment has been an active area of research in the field of mobile learning. Prior research has demonstrated that mobile‐based assessment systems positively affect student performance. However, it is still unclear why and how these systems positively affect student performance.ObjectivesThis study aims to identify the determinants of student performance during students' use of a mobile‐based assessment application in a formative assessment activity as part of English as a Foreign Language (EFL) courses in higher education.MethodsA structural model based on hypotheses was validated using PLS‐SEM with data from the interaction of 127 students of eight EFL courses from the A1 and A2 levels of English that used a mobile‐based assessment system for a period of 4 weeks. Automatic data collection in the application and self‐reported instruments were applied.Results and ConclusionsUse of scaffolding mechanisms, time on‐task and reported effort are strong predictors of students' learning outcomes. The use of scaffolding strategies predicts students' time on‐task. The provision of corrective feedback is not a predictor of students' learning performance but predicts other constructs such as perceived usefulness and the behavioural intention to use.ImplicationsMobile‐based assessment systems should include scaffolding mechanisms and integrate strategies to increase the perceived relevance of the formative assessment activity to increase the student learning performance. Scaffolding mechanisms are also useful to increase the student time on‐task in the formative assessment activity. In mobile‐based formative assessment activities more elaborated forms of feedback other than corrective feedback are needed to increase student performance.