Measuring Oral Reading Fluency (ORF) Computer-Based and Paper-Based: Examining the Mode Effect in Reading Accuracy and Reading Fluency
-
Published:2023-06-19
Issue:6
Volume:13
Page:624
-
ISSN:2227-7102
-
Container-title:Education Sciences
-
language:en
-
Short-container-title:Education Sciences
Author:
Jungjohann Jana1ORCID, DeVries Jeffrey M.2ORCID, Gebhardt Markus1ORCID
Affiliation:
1. Faculty of Human Science, University of Regensburg, 93053 Regensburg, Germany 2. Center for Research on Education and School Development, TU Dortmund University, 44227 Dortmund, Germany
Abstract
Internationally, teachers use oral reading fluency (ORF) measurements to monitor learning progress in reading and adapt instruction to the individual needs of students. In ORF measures, the child reads aloud single syllables, words, or short passages, and the teacher rates in parallel at which items the child makes a mistake. Since administering paper-based ORF requires increased effort on the part of teachers, computer-based test administration is available. However, there are still concerns about the comparability of paper-based and computer-based test modes. In our study, we examine mode effects between paper-based and computer-based test scores for both reading speed and reading accuracy using a German-language ORF assessment for progress monitoring. 2nd- and 3rd-year-students (N = 359) with and without special education needs participated in the study. Results show comparable and high reliability (r > 0.76) and no differential item functioning for both test modes. Furthermore, students showed significantly higher reading speed on the paper-based test, while no differences were found in reading accuracy. In the absence of differential item functioning, we discuss how mean differences can be accounted for, how teachers can be trained to use the different test modes, and how computer-based tests can be safeguarded in practice.
Subject
Public Administration,Developmental and Educational Psychology,Education,Computer Science Applications,Computer Science (miscellaneous),Physical Therapy, Sports Therapy and Rehabilitation
Reference69 articles.
1. Wilcox, G., Conde, C.F., and Kowbel, A. (2021). Using Evidence-Based Practice and Data-Based Decision Making in Inclusive Education. Educ. Sci., 11. 2. Bailey, T.R., Colpo, A., and Foley, A. (2020). Assessment Practices within a Multi-Tiered System of Supports, University of Florida. Available online: http://ceedar.education.ufl.edu/tools/innovation-configurations/. 3. Understanding and improving teachers’ graph literacy for data-based decision-making via video intervention;Jungjohann;Front. Educ.,2022 4. Powell, S.R., Bos, S.E., King, S.G., Ketterlin-Geller, L., and Lembke, E.S. (2022). Using the Data-Based Individualization Framework in Math Intervention. Teach. Except. Child., 00400599221111114. 5. DeVries, J.M., Szardenings, C., Doebler, P., and Gebhardt, M. (2021). Subject-Specific Self-Concept and Global Self-Esteem Mediate Risk Factors for Lower Competency in Mathematics and Reading. Soc. Sci., 10.
|
|