A novel frequency-range analysis (FRA) method for determining critical words among English high-stakes tests

Abstract

Within the new era of artificial intelligence (AI), education industry should develop in the direction of intelligence and digitalization. For evaluating learners’ academic performances, English high-stakes test is not only a mere means for measuring what English as a Foreign Language (EFL) stakeholders know or do not know but also likely to bring life-changing consequences. Hence, effective test preparation for English high-stakes test is crucial for those who futures depend on attaining a particular score. However, traditional corpus-based approaches cannot simultaneously take words’ frequency and range variables into consideration when evaluating their importance level, which makes the word sorting results inaccurate. Thus, to effectively and accurately extract critical words among English high-stakes test for enhancing EFL stakeholders’ test performance, this paper integrates a corpus-based approach and a revised Importance-Performance Analysis (IPA) method to develop a novel frequency-range analysis (FRA) method. Taiwan College Entrance Exam of English Subject (TCEEES) from the year of 2001 to 2022 are adopted as an empirical case of English high stake test and the target corpus for verification. Results indicate that the critical words evaluated by FRA method are concentrated on Quadrant I including 1,576 word types that account for over 60% running words of TCEEES corpus. After compared with the three traditional corpus-based approaches and the Term Frequency-Inverse Document Frequency (TF-IDF) method, the significant contributions include: (1) the FRA method can use a machine-based function words elimination technique to enhance the efficiency; (2) the FRA method can simultaneously take words’ frequency and range variables into consideration; (3) the FRA method can effectively conduct cluster analysis by categorizing the words into the four quadrants that based on their relative importance level. The results will give EFL stakeholders a clearer picture of how to allocate their learning time and education resources into critical words acquisition.