A Comparison of Rating Formats After Corrections for Attenuation

Abstract

It was noted that format comparisons for performance rating scales rarely report the most critical statistic in terms of assessing score comparability; i.e., the disattenuated correlation of scores between formats. This study examined the degree to which scores on different formats are correlated after disattenuation. Corrected correlations ranged from .7 to above 1.00. While it appears the scales are measuring essentially the same thing, several cautionary statements are made regarding the interpretation of the results. The failure to consider the purpose for data collection in these studies was one major problem cited.