Evaluation competencies and functions in advertised evaluation roles in Australia

Abstract

This study explores the functions of professional evaluators outlined in online job advertisements. A total of 97 job advertisements were reviewed in the study. A content analysis using a Coding Analysis Toolkit developed by Shulman was conducted to identify six main evaluation functions based on the collected data. These functions are (1) evaluation and reporting, (2) providing evaluation advice, (3) evaluation capacity building, (4) communication and engagement, (5) forming partnerships and (6) leading, managing and influencing. These functions were then compared to the Australian Evaluation Society’s (AES) Core Competency Domains. Overall, there is a broad alignment between these functions and the AES Core Competency Domains. However, the analysis shows that the delivery of culturally competent evaluations and evaluation utilisation received no mention in advertised evaluation roles. The delivery of culturally competent evaluation is essential from the perspective of ethics, validity and theory, while the utilisation of evaluation findings is important for the benefit of society.