Related Experiment Video
Updated: May 13, 2026

11:45
Creation of a High-Fidelity, Low-Cost, Intraosseous Line Placement Task Trainer via 3D Printing
Published on: August 17, 2022
Comparative research on training simulators in emergency medicine: a methodological review
Matthew Lineberry1, Melissa Walwanis, Joseph Reni
1University of Illinois at Chicago, Chicago, IL, USA. MattL@uic.edu
Summary
Comparative studies on healthcare simulation training effectiveness face methodological challenges. Future research needs improved power, appropriate statistical tests, and better performance measures for valid conclusions.
Area of Science:
- Medical Education
- Healthcare Simulation
- Emergency Medicine Training
Background:
- Healthcare simulation-based training is crucial for skill development.
- Calls for comparative studies on simulation modalities are frequent.
- Existing comparative research faces significant methodological hurdles.
Purpose of the Study:
- To analyze methodological factors in studies comparing simulation modalities in emergency medicine.
- To identify limitations in current comparative simulation research.
- To provide recommendations for improving future research.
Main Methods:
- Systematic literature review of 20 studies.
- Analysis focused on key methodological factors.
- Evaluation of statistical power, equivalence testing, and performance criterion test beds.
Main Results:
- Most reviewed studies were underpowered to detect meaningful effects.
- Inappropriate statistical tests were used for equivalence testing.
- Performance measures may not accurately reflect on-the-job performance.
Conclusions:
- Current comparative simulation research in emergency medicine has critical methodological flaws.
- Recommendations include increasing statistical power, using correct equivalence tests, and validating performance measures.
- Addressing these issues is vital for advancing simulation-based training effectiveness.
