Related Experiment Video
Updated: May 14, 2026
09:52
Setting Up a Stroke Team Algorithm and Conducting Simulation-based Training in the Emergency Department - A Practical Guide
Published on: January 15, 2017
Preparing Emergency Medicine Residents for the Certifying Exam: A Pilot Study of a Longitudinal Simulation-Based
Jennifer Yee1, Christopher E San Miguel1, Krystin N Miller1
1Department of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
AEM Education and Training
|May 13, 2026
Summary
A simulation-based assessment program is feasible for evaluating emergency medicine residents. This pilot study highlights performance variability and identifies areas for targeted educational improvement to ensure competency.
Area of Science:
- Medical Education
- Simulation-Based Assessment
- Emergency Medicine Training
Background:
- The American Board of Emergency Medicine (ABEM) introduced a new Certifying Exam using simulated clinical environments.
- Residency programs must verify resident competency and prepare them for board certification.
- Simulation offers reproducible and controlled evaluations for assessing performance.
Purpose of the Study:
- To determine the feasibility of a simulation-based assessment program for emergency medicine residents.
- To evaluate resident performance across resuscitation, procedural skills, and communication domains.
- To provide objective data for program director attestations of competence.
Main Methods:
- Eight assessment stations were developed based on ABEM exam content, ACGME Milestones, and Entrustable Professional Activities.
- Scenarios covered resuscitation, procedural skills (e.g., laryngoscopy, cricothyrotomy), and communication (breaking bad news).
- Minimum Competency Scores (MCS) were established using the Mastery Angoff process.
Main Results:
- Thirty residents participated; none achieved MCS on all eight stations, averaging 4.24 stations met.
- Significant performance variability was observed, particularly in Pediatric Medical, Neonatal Resuscitation, and Breaking Bad News scenarios.
- Residents demonstrated higher competency in procedural skills assessments compared to other domains.
Conclusions:
- Simulation-based assessment is a feasible method for gathering objective evidence of clinical competency in emergency medicine.
- Assessment feedback can guide resident educational plans and identify program-wide needs.
- Data supports evaluating resident readiness for independent practice and board certification preparation.
