Useful to whom? Evaluation utilisation theory and boundaries for programme evaluation scope

Area of Science:

• Health Professions Education
• Programme Evaluation
• Educational Research

Background:

• Programme evaluation is a standard requirement in health professions education.
• Existing guidance focuses on 'how' to conduct evaluations, but less on the 'value' stakeholders seek.
• Evaluation utilisation theory offers insights into the motivations and outcomes of programme evaluation.

Purpose of the Study:

• To explore the concept of evaluation utilisation in health professions education.
• To examine different forms of evaluation utilisation and misuse.
• To discuss how prioritising utilisation influences evaluation scope and impact.

Main Methods:

• Drawing on evaluation theory and research.
• Discussing various forms of evaluation utilisation: instrumental, conceptual, process, and persuasive (symbolic and legitimative).
• Addressing the concept of evaluation misuse.

Main Results:

• Evaluation utilisation is the application of evaluation processes and findings to influence thinking and action.
• Different stakeholders have diverse priorities for evaluation value.
• Prioritisation of utilisation forms impacts evaluation scholarship.

Conclusions:

• Programme evaluation requires attention to stakeholder priorities beyond just methodology.
• Evaluation utilisation theory can critically examine practices and impact in health professions education.
• Understanding utilisation helps align evaluation methods with scholarly, curricular, and administrative goals.