Student Evaluations of Teaching Do Not Reflect Student Learning: An Observational Study

Author:

Gilbert Robert O1,Gilbert Dave R2

Affiliation:

1. Ross University School of Veterinary Medicine

2. University of British Columbia

Abstract

Abstract

Background: Student Evaluations of Teaching (SET) are routinely utilized in the assessment of university faculty for purposes of hiring, promotion, tenure, and merit-based salary increases. Despite their ubiquity, much evidence exists that they are biased, amongst other factors by expected and received student grades. To our knowledge, this issue has not been examined in veterinary education. Furthermore, it remains unclear whether the combination of higher grades and more favorable student evaluations might reflect enhanced learning. Our study evaluates the relationship between (A) student evaluations of courses in a veterinary curriculum, (B) grades earned in those courses, and (C) independent measures of learning in those subjects. Methods: The Veterinary Educational Assessment (VEA) is an independent, external exam in basic sciences subjects administered by the International Council for Veterinary Assessment and is taken by Ross University School of Veterinary Medicine (RUSVM) students in their fifth semester of study. It offers an external means of measuring student learning in specific subjects and relating them to course evaluations. RUSVM has three terms each year with three separate intakes of students. Course evaluations and student grades were recorded for courses from fall 2018 to summer 2022, spanning 12 cohorts of students, and 152 individual courses. Courses were aligned to the relevant section of the VEA taken by each cohort. Spearman correlation coefficients were calculated. Results: Mean course evaluations were significantly positively correlated to median grade in the course (rho = 0.33, P < 0.0001) and the proportion of students earning A-grades (rho = 0.35, P < 0.0001). The relationship between course evaluation and relevant VEA score was negative (rho = -0.18, P = 0.027), indicating that students judged courses favorably when higher grades were expected without necessarily learning more from those courses. Conclusions: We confirmed the well-known relationship between SET and student grades but, for the first time in veterinary medicine, describe a small but negative relationship between SET and an independent measure of learning. SET should be interpreted with caution; their use for evaluation of teachers may have unintended consequences including reduced expectations for student achievement.

Publisher

Research Square Platform LLC

Reference20 articles.

1. Miller J, Seldin P. Changing practices in faculty evaluations: can better evaluation make a difference? American Association of University Professors; 2014. https://www.aaup.org/article/changing-practices-faculty-evaluation. [cited 2023 November 22].

2. Gender biases in student evaluations of teaching;Boring A;J Public Econ,2017

3. Gender and cultural bias in student evaluations: Why representation matters;Fan Y;PLoS ONE,2019

4. Beauty in the classroom: Instructors pulchritude and putative pedagogical productivity;Hamermesh DS;Econ Educ Rev,2005

5. How beauty works. Theoretical mechanisms and two empirical applications on students' evaluation of teaching;Wolbring T;Soc Sci Res,2016

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3