Abstract
AbstractThis study examines the range of cognitive processes assessed in the English language reading literacy test as part of the Hong Kong Diploma of Secondary Education Examination (HKDSE), the secondary school exit test in Hong Kong. Prior studies have suggested that higher order cognitive processes are often undermined in high-stakes tests and classrooms, due to what is called the “washback effect.” This prompts the following hypothesis: despite its top-performing education system, Hong Kong has failed to provide a versatile collection of test items that involve complex reasoning. To investigate the cognitive demands of the test, as well as their relationship with student performance, this study maps the test items with reference to the cognitive levels assessed using in-depth document analysis. ANOVA is used to statistically determine differences in accuracy rates to supplement the analysis throughout. Results indicate that the test has placed an overwhelming emphasis on lower order cognitive processes over the past decade (2012–2019) and that items assessing higher order cognitive skills are, as expected, met with statistically significantly poorer performance in the test. Implications for future revision of the test and curriculum policy are discussed.
Publisher
Springer Science and Business Media LLC
Subject
Linguistics and Language,Language and Linguistics
Reference46 articles.
1. Alderson, J. C. (2010). Assessing reading. Cambridge University Press.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2014). Standards for educational and psychological testing. American Educational Research Association. https://doi.org/10.4135/9781506326139.n662.
3. Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., … Wittrock, M. C. (2001). Taxonomy for learning, teaching and assessing: A revision of Bloom’s taxonomy of educational objectives. Longman.
4. Bacon-Shone, J., Bolton, K., & Luke, K. K. (2015). Language use, proficiency and attitudes in Hong Kong. The University of Hong Kong.
5. Bensoussan, M., Goldenblatt, L., & Kreindler, I. (1984). Changing the difficulty level of multiple-choice EFL reading comprehension questions. Language Testing, 1(1), 105–109. https://doi.org/10.1177/026553228400100110.