The relationship between involvement in and use of evaluation in multi-site evaluations

Area of Science:

• Evaluation Science
• Social Science Research Methods

Background:

• Evaluation use is critical for program improvement and decision-making.
• Multi-site evaluations present unique challenges for participation and use compared to single-site contexts.

Purpose of the Study:

• To explore the relationship between participation in evaluation and the utilization of evaluation findings and processes.
• To identify factors influencing evaluation use in large-scale, multi-site evaluations.

Main Methods:

• Canonical correlation analysis was employed to statistically examine relationships.
• Qualitative data were gathered through 20 in-depth interviews.
• Data were sourced from the NSF-funded research project 'Beyond Evaluation Use' (Lawrenz & King, 2009).

Main Results:

• Findings suggest that certain participatory evaluation theories and beliefs positively influence use and impact, mirroring single-site evaluations.
• Key differences were identified in the dynamics of participation and use within multi-site settings.
• Specific planning and implementation considerations were highlighted for enhancing evaluation use.

Conclusions:

• Participatory evaluation principles can be adapted for multi-site contexts to foster greater use.
• Addressing the unique aspects of multi-site evaluations is crucial for maximizing their influence.
• Recommendations are provided for evaluators and funders to improve the utility of multi-site evaluations.