When (not if) evaluation flexibility is desirable. Examples from the CPHPE initiative.

Area of Science:

• Program evaluation
• Health professions education
• Community-based initiatives

Background:

• Ongoing debate in evaluation literature regarding the necessity of flexibility in evaluation design and activities.
• The need for evaluators to collaborate with program directors and respond to evolving programming needs.

Purpose of the Study:

• To identify specific conditions under which evaluation flexibility is not just desirable but essential.
• To illustrate the critical role of flexibility using case examples from a large-scale health professions education initiative.

Main Methods:

• Case study analysis of a cluster evaluation of the W. K. Kellogg Foundation's Community Partnerships for Health Professions Education initiative.
• Examination of two distinct scenarios requiring adaptive evaluation strategies.

Main Results:

• Flexibility proved essential when programs underwent goal clarification, particularly concerning community involvement.
• Adaptability was crucial to document program efforts to maintain integrity amidst national health care reform and policy shifts.
• Evaluation team strategies for managing flexibility in response to external turbulence and internal program evolution are detailed.

Conclusions:

• Evaluation flexibility is a critical component for successful outcomes in complex, dynamic program environments.
• Specific conditions, such as goal clarification and external policy turbulence, necessitate adaptive evaluation approaches.
• Responsive evaluation designs enhance the validity and utility of findings in health professions education initiatives.