Constructing Progress Maps of Digital Technology for Diagnosing Mathematical Proficiency

Abstract

This research aims to construct and validate progress maps of digital technology for diagnosing the multidimensional mathematical proficiency (MP) in Number and Algebra for Grade 7 students utilizing the Construct Modeling Approach. Researchers employed four building blocks as follows. Firstly, researchers developed the progress maps as an assessment framework of multidimensional MP. This is followed by creating the test for diagnosing MP. Next, researchers assigned scoring criteria and created the transition points of students’ MP levels. Finally, researchers validated the quality of the progress maps through empirical evidence. A total sample 1,500 Grade 7 students was used to support the validity and reliability evidence of the progress maps through the Wright Map using Multidimensional Random Coefficients Multinomial Logit Model. Results revealed that there were two dimensions of progress maps, namely mathematical procedures (MAP) and structure of learning outcome (SLO), and the researchers investigated three strands of validity evidence, namely test content, response processes, and internal structure. The reliability values in the MAP and SLO were 0.84 and 0.80 respectively. Finally, the Grade 7 students were mainly found to be at level-2 in the MAP dimension (44.95%) and the SLO dimension (61.57%). The experts’ evaluation results showed that the digital technology that was developed at the “most appropriate” quality levels in terms of usefulness, suitability, and accuracy, and at the “very appropriate” for the feasibility aspect, and hence is successfully contributing to the clarification of learning goals, to support for student-centered instruction, and that it is helpful in improving in teacher professional development.