Critical Analysis of Translation Tests in 18 Specialized Translation Courses for Undergraduate Students

Abstract

The present study aimed to describe and evaluate the current assessment practices prevalent in the different translation courses offered at the College of Languages and Translation (COLT). A sample of specialized translation final exams in 18 translation subject areas was collected.  Each final exam was analyzed in terms of the following: (1) # of English and Arabic source texts included on each final exam for each course (2) readability and difficulty level of texts included in the translation exams, (3) # of exams with a terminology subtest, (4) English and Arabic text length in words, (5) reliability, validity and discriminating power of final exams. Data analysis showed that 50% of the exams included one English text, 32% included 2 texts and 18% included 3 texts. Arabic texts were included in 73% of the exams. However, 59% of the exams included one Arabic text, 9% included two texts and 5% included 3 texts.  In Addition to English and Arabic texts, 56% of the exams included a vocabulary subtest.  41% do not have any Arabic texts. The English text length ranged between 66-430 words with a median length of 181 words. The Arabic text length ranged between 26-180 with a median length of 97. The typical Flesch Reading Ease of English texts was 40 and the typical Flesch-Kincaid Grade level score was 11. There were no significant differences among the different college levels nor different subject areas in text length or text difficulty level. Translation exams currently used at COLT lack validity, reliability, and discriminating power. Some reasons for lack of reliability and validity are given. Students’ views on translation exams are also reported. A model for more valid, reliable, and discriminating translation exams is given with students views of it as well.