Student Evaluations of Courses and Faculty Based on a Perceived Learning Criterion: Scale Construction, Validation, and Comparison of Results

Abstract

Validation studies of the Course-Faculty Evalua tion Instrument (CFI) are described. Seven dimen sions were constructed which characterize each class and predict student rating of the instructor, course, and text. Different measurement scales and methods were analyzed, using a multitrait-multi method (MTMM) strategy. The MTMM matrix for the CFI and a similar MTMM matrix for the Course-Evaluation Instrument (CEI) reported by Schwab (1974) were analyzed and compared. The same method of scaling was found to be superior in both studies. Using an analysis of variance frame work to summarize MTMM matrices, the CFI demonstrated greater discriminant validity using more dimensions (traits) and had a lower error component than the CEI. The benefits of compar ing instruments and implications for future course- faculty evaluation research are discussed.