Evaluation for farming systems improvement: looking backwards, thinking forwards

Abstract

Based on personal reflection, this paper presents program evaluation as a vehicle to bring about better project results and perhaps even a better world. New paradigm approaches to farming systems improvement feature multiple collaborators in work that is increasingly participatory, process-oriented and diverse in outcome. This is often accompanied by pressure for rapid feedback and dialogue. Conventional objectives-based evaluation methods are insufficient to capture the range of unanticipated outcomes that this work may produce, and may be incompatible with a participatory ethos. In the contemporary farming systems improvement context, evaluation is most valuable when it has short-cycles and fosters reflection. Two contrasting techniques that offer promise for meeting these needs are the most significant change technique, and participatory approaches to program logic. Presenting a radical departure from conventional monitoring against quantitative indicators, most significant change technique involves the regular collection and participatory interpretation of ‘stories’ about change rather than predetermined quantitative indicators. Program logic is the rationale behind a program or project — what are understood to be the cause and effect relationships between project activities, outputs, intermediate outcomes, and ultimate outcomes. When done in group situations, program logic offers many benefits by enabling participants to question the cause and effect assumptions to improve project design. These techniques can supplement traditional approaches; closing some of the information gaps identified by contemporary farming systems improvement work.