Abstract
AbstractIn educational research, teaching quality is extensively studied because of its role of a mediator between teacher characteristics and student learning. However, empirical evidence on differences between video and live scoring of teaching quality is rare. In the present study, thirty lessons from 15 secondary mathematics classrooms in a German metropolitan area were observed. Lessons were scored both live in the classroom and using video recordings. Live and video scoring was conducted by (different) trained observers. Ratings were obtained with a “hybrid” observational instrument that covers generic and subject-specific characteristics of teaching quality in mathematics classrooms. Generalizability analysis and paired t tests were performed to investigate mode effects. The findings showed that in live scoring, classroom management was rated lower, and cognitive activation was rated higher. Rankings of lessons or classrooms were very similar across modes, and reliabilities did not differ to a meaningful extent either, except for classroom management reaching better results for live ratings. This suggests that based on the present findings, classroom observation performed with our hybrid framework of teaching quality generalizes across observation mode only under certain circumstances. Further research is necessary to better understand the relation between observation mode and teaching quality ratings, as well as the impact of the scoring procedures. We discuss the implications of our findings for educational research and practice.
Publisher
Springer Science and Business Media LLC
Reference47 articles.
1. Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., & Tsai, Y. M. (2010). Teachers’ mathematical knowledge, cognitive activation in the classroom, and sudent progress. American Educational Research Journal, 47(1), 133–180. https://doi.org/10.3102/0002831209345157.
2. Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., & Qi, Y. (2012). An argument approach to observation protocol validity. Educational Assessment, 17(2–3), 62–87. https://doi.org/10.1080/10627197.2012.715014.
3. Benecke, K., & Kaiser, G. (2023). Teachers’ approaches to handling student errors in mathematics classes. Asian Journal for Mathematics Education, 2(2), 161–182. https://doi.org/10.1177/27527263231184642.
4. Bill and Melinda Gates Foundation (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains Bill and Melinda Gates Foundation. Retrieved from http://www.metproject.org/downloads/MET_Gathering_Feedback_Research_Paper.pdf.
5. Blömeke, S., Jentsch, A., König, J., & Kaiser, G. (2022). Opening up the black box: Teacher competence, instructional quality, and students’ learning progression. Learning and Instruction, 79, 101600. https://doi.org/10.1016/j.learninstruc.2022.101600.