Assessing healthcare simulation facilitation using a competency-based tool derived from practice in low-resource...

Area of Science:

• Healthcare Simulation
• Medical Education
• Faculty Development

Background:

• Healthcare simulation training is expanding globally, including in low-resource settings.
• A specific framework for assessing facilitation competencies in these settings was previously lacking.
• This study addresses the need for a validated tool to evaluate simulation facilitation.

Purpose of the Study:

• To develop and assess the reliability of the Facilitation Behavioural Assessment Tool (FBAT).
• To evaluate the FBAT's effectiveness in scoring facilitation performance in simulated healthcare training.
• To support simulation faculty development, particularly in resource-limited environments.

Main Methods:

• The FBAT includes 32 competencies across techniques, artistry, and values, scored on a three-point scale.
• 104 participants from 29 countries completed online training and scored three standardized videos.
• Inter-rater reliability (ICC2, ICC2k) and internal consistency (Cronbach's α) were calculated.

Main Results:

• High inter-rater reliability was achieved (ICC2=0.73, ICC2k=0.89).
• Strong internal consistency was found across videos (Cronbach's α ranging from 0.84 to 0.91).
• Novice facilitators scored differently than experienced ones, but overall discrimination between performance levels was successful.

Conclusions:

• The Facilitation Behavioural Assessment Tool demonstrates suitable reliability and internal consistency.
• The FBAT is recommended for supporting faculty development through learning conversations in simulation, especially in low-resource settings.