An overview of realist evaluation for simulation-based education

Area of Science:

• Medical Education
• Evaluation Methodology

Background:

• Simulation-based education (SBE) is increasingly utilized for its substantial educational benefits.
• There is a growing demand for theory-driven research in SBE to understand its effectiveness and underlying mechanisms.
• Existing evaluation methods often fail to address the complexity of SBE interventions.

Purpose of the Study:

• To describe the principles of realist evaluation.
• To illustrate the application of realist evaluation to simulation-based education.
• To highlight realist evaluation's capacity to answer 'why' and 'how' questions in SBE.

Main Methods:

• Realist evaluation employs a mixed-methods approach (qualitative and quantitative data).
• It focuses on identifying the context, mechanisms, and outcomes (CMO configurations) of an intervention.
• The methodology is applied to a simulation-based course for final-year medical students as a case example.

Main Results:

• Realist evaluation provides a framework to understand how educational programs achieve successful outcomes.
• It elucidates the interplay between context, mechanisms, and outcomes in SBE.
• The approach facilitates a deeper understanding of SBE effectiveness beyond simply 'did it work?'

Conclusions:

• Realist evaluation is a suitable methodology for complex interventions like SBE.
• It addresses the need for theory-driven research by exploring the 'why' behind SBE effectiveness.
• This approach enhances the understanding of SBE by examining context, mechanisms, and outcomes.