Assessing the Effectiveness of Research Organizations

Abstract

Assessing the effectiveness of research organizations in education (as well as those in the social sciences) is hampered by the lack of measurable goals and identifiable outcome criteria. In this review, key issues in evaluating effectiveness are identified and insights on the application of major assessment approaches are provided. Most research organizations in education tend to have ambiguous goals and incomplete technologies or strategies for achieving them. The goal-attainment approach with its emphasis on efficiency and output measures tells only a limited story of effectiveness. The stakeholder approach, emphasizing social references and extrinsic measures, is more relevant, for it indicates the extent to which stakeholders'needs are satisfied. The systems approach is useful in sensitizing evaluators to the importance of internal processes in improving organizational effectiveness. The competing values framework is an attempt to integrate major assessment paradigms. It shows that value trade-offs are inherent in the selection of evaluation approaches. Understanding an organization's focus, structure, and outcome will facilitate the ultimate choice of effectiveness criteria and evaluation strategies.