Do writing performance and examination grading correlate in an EMI university setting?

Abstract

Abstract We studied German students’ academic writing skills in English at a Dutch university. Their performances are typical examples of English as a lingua franca (ELF) as these students are non-native users of English evaluated by subject lecturers who are non-native users as well. Our database is a corpus of written answers to an open examination question in the context of an EMI (English Medium Instruction) bachelor in psychology. We aimed to detect those characteristics in this specific type of discourse that may affect the comprehensibility of the students’ answers, which in turn may have consequences for their grading by the course lecturer. English language experts assigned Common European Framework of Reference (CEFR) levels and commented on grammar, use of (academic) vocabulary, and text coherence. First, we correlated the grades assigned by the course lecturer and the CEFR levels. There was no correlation. Second, we analyzed the linguistic comments. We found that academic style was poorly present in this type of text. Importantly, we found no proof of communicative blockings or obstacles related to English proficiency levels between the student writer and the lecturer reader. We conclude that informed content interpretation based on contextual appropriateness of the answers overrules grammatical and lexical non-standard characteristics and outweighs the lack of semantic coherence.