Complementary strengths? Evaluation of a hybrid human-machine scoring approach for a test of oral academic English-Reference-Cited by-同舟云学术

Complementary strengths? Evaluation of a hybrid human-machine scoring approach for a test of oral academic English

Published:2021-07-04 Issue:4 Volume:28 Page:437-455
ISSN:0969-594X
Container-title:Assessment in Education: Principles, Policy & Practice
language:en
Short-container-title:Assessment in Education: Principles, Policy & Practice

Author:

Davis Larry¹^ORCID,Papageorgiou Spiros¹^ORCID

Affiliation:

1. Center for Language Education and Assessment Research, Educational Testing Service, Princeton, NJ, USA

Funder

Educational Testing Service

Publisher

Informa UK Limited

Subject

Education

Link

https://www.tandfonline.com/doi/pdf/10.1080/0969594X.2021.1979466

Reference34 articles.

1. Chen, L., Zechner, K., Yoon, S. Y., Evanini, K., Wang, X., Loukina, A., Tao, J., Davis, L., Lee, C. M., Ma, M., Mundkowsky, R., Lu, C., Leong, C. W. & Gyawali, B. (2018). Automated scoring of nonnative speech using the SpeechRaterSM v. 5.0 engine (Research Report No. RR-18–10). Educational Testing Service. https://doi.org/10.1002/ets2.12198

2. Educational Testing Service. (2017). How the test is scored. https://www.ets.org/gre/revised_general/scores/how/

3. Educational Testing Service. (2019). TOEFL iBT speaking section scoring guide. https://www.ets.org/s/toefl/pdf/toefl_speaking_rubrics.pdf

4. Educational Testing Service. (2020a). TOEFL Research Insight Series Volume 2: TOEFL Research. https://www.ets.org/s/toefl/pdf/toefl_ibt_insight_s1v2.pdf

Cited by 8 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Short answer scoring with GPT-4;Proceedings of the Eleventh ACM Conference on Learning @ Scale;2024-07-09

2. Automated Sign Language Vocabulary Assessment: Comparing Human and Machine Ratings and Studying Learner Perceptions;Language Assessment Quarterly;2024-05-26

3. MxML (Exploring the Relationship between Measurement and Machine Learning): Current State of the Field;Educational Measurement: Issues and Practice;2024-01-29

4. Challenges and opportunities for spoken English learning and instruction brought by automated speech scoring in large-scale speaking tests: a mixed-method investigation into the washback of SpeechRater in TOEFL iBT;Asian-Pacific Journal of Second and Foreign Language Education;2023-08-15

5. Assessment of fluency in the Test of English for Educational Purposes;Language Testing;2023-03-13