Evaluation for program decision making: a case study of the Oportunidades program in Mexico

Although evaluation is now an integral part of the design and implementation of public programs in many countries, there is growing recognition that the utilization of evaluation results for improving implementation and decision making, particularly in developing countries, is limited. The objective of this paper is to describe the process by which the external impact evaluation has been used to increase the potential of Oportunidades to improve nutritional outcomes of the beneficiary population through modifications to its design and operation. We will summarize a series of studies that have guided this process and focus on key aspects that have facilitated the utilization of evaluation results for decision making in the program. Implementation of research to document the impact of programs and the publication of such findings in peer reviewed journals, although vital for improving our evidence base and for the advancement of researchers within the current academic system, is not enough to ensure that the program itself will benefit from the evaluation. The use of evaluation results as a basis for modifications to the design and implementation of the nutrition component of Oportunidades was favored by open dialogue among all sectors involved in the program and the evaluation team and a long-term commitment on the part of all those involved. We think that the lessons learnt from this process are relevant for other programs, even where resources may be limited.