Closing the Gap: Automated Distractor Generation in Japanese Language Testing
-
Published:2023-11-30
Issue:12
Volume:13
Page:1203
-
ISSN:2227-7102
-
Container-title:Education Sciences
-
language:en
-
Short-container-title:Education Sciences
Author:
Andersson Tim1, Picazo-Sanchez Pablo1ORCID
Affiliation:
1. School of Information Technology, Halmstad University, 301 18 Halmstad, Sweden
Abstract
Recent advances in natural language processing have increased interest in automatic question generation, particularly in education (e.g., math, biology, law, medicine, and languages) due to its efficiency in assessing comprehension. Specifically, multiple-choice questions have become popular, especially in standardized language proficiency tests. However, manually creating high-quality tests is time-consuming and challenging. Distractor generation, a critical aspect of multiple-choice question creation, is often overlooked, yet it plays a crucial role in test quality. Generating appropriate distractors requires ensuring they are incorrect but related to the correct answer (semantically or contextually), are grammatically correct, and of similar length to the target word. While various languages have seen research in automatic distractor generation, Japanese has received limited attention. This paper addresses this gap by automatically generating cloze tests, including distractors, for Japanese language proficiency tests, evaluating the generated questions’ quality, difficulty, and preferred distractor types, and comparing them to human-made questions through automatic and manual evaluations.
Subject
Public Administration,Developmental and Educational Psychology,Education,Computer Science Applications,Computer Science (miscellaneous),Physical Therapy, Sports Therapy and Rehabilitation
Reference68 articles.
1. Araki, J., Rajagopal, D., Sankaranarayanan, S., Holm, S., Yamakawa, Y., and Mitamura, T. (2016, January 11). Generating Questions and Multiple-Choice Answers using Semantic Analysis of Texts. Proceedings of the COLING, Osaka, Japan. 2. Satria, A.Y., and Tokunaga, T. (2017, January 21–23). Automatic generation of english reference question by utilising nonrestrictive relative clause. Proceedings of the CSEDU, Porto, Portugal. 3. Susanti, Y., Iida, R., and Tokunaga, T. (2015, January 23–25). Automatic Generation of English Vocabulary Tests. Proceedings of the CSEDU, Lisbon, Portugal. 4. Zhang, C., Sun, Y., Chen, H., and Wang, J. (2020). Generating Adequate Distractors for Multiple-Choice Questions. arXiv. 5. Thalheimer, W. (2023, November 01). Learning Benefits of Questions, V2.0. Available online: https://www.worklearning.com/wp-content/uploads/2017/10/Learning-Benefits-of-Questions-2014-v2.0.pdf.
|
|