A Systematic and Quantitative Method to Measure the Achieved Program Learning Outcomes in Higher Education

Abstract

This study calculates the level of academic program learning outcomes achieved through a course/module/unit within a higher education institution. The study draws on hypothetical data (secondary data), of a computer science course. The approach of the study demonstrates an empirical, reliable, and robust method to measure the level of program learning outcomes delivered and achieved. The method to calculate the level of learning outcomes uses a graded hypothetical assessment, charted in a specification table. The percentage covered is the ratio of the course learning outcome covered by the assessment then multiplied by the probability of a course learning outcome to occur in program learning outcome. The method is based on several specification table alignments between course learning outcomes and program learning outcomes. Embedded in the specification tables is assessment data that reflect what is covered and achieved of the curriculum. The originality of this study is that it posts a robust methodology to calculate objectively the achieved learning outcomes. The findings lead us to think in new ways to reconceptualize how students are assessed in higher education. Thus, rather than assess students on how they achieve on course tests and other tasks; students can be assessed on the learning outcomes they have achieved.