Using Self-Assessments to Detect Workshop Success

Abstract

An accepted gold standard for measuring change in participant behavior is third-party observation. This method is highly resource intensive, and many small-scale evaluations may not be in a position to use this approach. This study was designed to assess the validity and reliably of aggregated group self-assessments as one way to measure workshop effectiveness. In this study, participants completed a pre-, post-, and retrospective self-assessment on their perceived skill level in delivering feedback. Trained raters scored recorded role-play episodes. A statistically and practically significant difference in feedback skills was detected in both the self-assessments and observer ratings. The instruments used to assess participants' feedback skills had acceptable reliability. Those charged with workshop evaluation should have some confidence that aggregated self-assessments can be used to help determine workshop effectiveness.