Evolutionary Evaluation: implications for evaluators, researchers, practitioners, funders and the evidence-based...

Area of Science:

• Program Evaluation
• Evolutionary Theory
• Developmental Systems Theory

Background:

• Traditional program evaluation often overlooks the dynamic, evolving nature of programs.
• Existing theoretical frameworks lack a cohesive model for understanding program development and evaluation over time.

Purpose of the Study:

• To introduce and operationalize a model of Evolutionary Evaluation grounded in evolutionary theory, developmental systems theory, and evolutionary epistemology.
• To align program and evaluation phases with validity types and incorporate program development models.
• To re-examine controversies in program evaluation, such as the role of randomized controlled trials and evidence-based programs.

Main Methods:

• Relating core concepts from evolutionary theory, developmental systems theory, and evolutionary epistemology to program evaluation.
• Operationalizing Evolutionary Evaluation through program and evaluation evolutionary phases.
• Aligning these phases with multiple types of validity and incorporating bottom-up versus top-down program development models.

Main Results:

• The proposed Evolutionary Evaluation framework has significant implications for program management and evaluation.
• This perspective illuminates challenges posed by prevailing interpretations of rigor and mandates for evidence-based programs to program evolution.
• It highlights the consequences of misalignment between program and evaluation phases and the need for diversity in program portfolios.

Conclusions:

• Evolutionary Evaluation provides a novel lens for understanding and managing evolving programs.
• Rethinking "evidence-based programs" is necessary, as rigid interpretations can hinder program evolution.
• Supporting diverse program types and ensuring alignment between program and evaluation phases are crucial for effective program development.