MITIGATING RESPONDENT FATIGUE IN SELF-ASSESSMENT: CEFR-BASED ITEMS FOR MALAYSIAN UNDERGRADUATES

Abstract

Background and Purpose: The Common European Framework of Reference for Languages (CEFR) is an internationally recognised instrument for describing language skills. It describes language proficiency on a six-level scale, ranging from A1 for beginners to C2 for those who have already mastered a language. The roadmap in the Malaysian Education Plan 2013-2025 sets B2 as the target for Malaysian higher education graduates as this is the level at which they can expect to get a job and function adequately in English, while graduates of English language degree programmes are expected to reach C1 when they graduate. The aim of this study is to test and verify whether it is appropriate to use only the items from B2, C1 and C2 to measure the language proficiency of Malaysian students to avoid respondent fatigue in answering the questionnaire.   Methodology: A proportionate stratified random sampling method was used and four strata were defined: Strata I and II were male and female students in public institutions, Strata III and IV were male and female students in private institutions. The instrument used was a questionnaire containing demographic profiles and eight items from the CEFR Global Self-Assessment Grid. Exploratory factor analysis and reliability analysis were conducted using SPSS.   Findings: The eigenvalue of 7.263 with factor loadings between 0.774 and 0.854 and the Cronbach’s alpha value for language ability of over 0.9 indicate excellent reliability of the selected items. The study found that Malaysian university students were good at understanding and discussing personal information, events, opinions and plans. However, they found it difficult to understand complex and longer texts, to use language flexibly in social and academic settings and to express themselves without constantly asking for feedback. As the current education system focuses too much on memorization, it does not contribute to the development of practical language skills. In order to improve, students should use the CEFR as a self-assessment tool.   Contributions: The findings of the study contribute to the understanding of the optimization of the CEFR framework in Malaysian higher education by reducing respondent fatigue and improving the quality of self-assessment. The study provides empirical evidence of the effectiveness of using CEFR-based items at B2, C1 and C2 levels in reducing fatigue, improving the quality of self-assessment and informing language teaching and learning practices. The findings can assist educators and policy makers in developing more effective language teaching and assessment strategies that promote student learning outcomes and ultimately improve the language education of Malaysian students.   Keywords: CEFR rubric, ESL, self-assessment, perceived language proficiency, answering fatigue.   Cite as: Tg Nur Liyana, T. M. F., Wan Nazihah, W. M, & Mimi Mazlina, M. (2024). Assessing the self-perceived language proficiency of Malaysian ESL learners in higher education utilizing the Common European Framework of Reference (CEFR).  Journal of Nusantara Studies, 9(2), 474-489. http://dx.doi.org/10.24200/jonus.vol9iss2pp474-489