Related Experiment Video
Updated: Aug 14, 2026
09:52
Setting Up a Stroke Team Algorithm and Conducting Simulation-based Training in the Emergency Department - A Practical Guide
Published on: January 15, 2017
Evaluation of medical students' performance using the anaesthesia simulator
1Department of Anaesthesia, Sunnybrook Health Science Centre, 2075 Bayview M3-200, Toronto, Ontario, Canada M4N 3 M5.
Medical Education
|December 22, 1999
Summary
This pilot study found that anesthesia simulators reliably assess medical student performance. While simulator scores did not correlate with written or clinical exams, students rated the experience highly.
Area of Science:
- Medical Education
- Simulation Technology
- Anesthesiology
Background:
- Assessing clinical performance is crucial for medical education.
- Simulation centers offer a controlled environment for performance evaluation.
- Traditional assessment methods may have limitations.
Purpose of the Study:
- To evaluate the reliability of a simulator as an assessment tool for medical students' clinical performance in anesthesiology.
- To compare simulator-based assessments with traditional written and clinical evaluations.
- To gather student feedback on the simulator experience.
Main Methods:
- A pilot study involved 24 medical students at the University of Toronto.
- Students completed videotaped simulator sessions with standardized cases.
- Performance was assessed by five independent evaluators using defined criteria; inter-rater reliability was calculated.
- Simulator scores were compared to written and clinical examination marks.
- Student satisfaction was surveyed.
Main Results:
- High inter-rater reliability (ICC=0.87) was observed for simulator assessments.
- Poor correlations were found between simulator scores and written (r=0.19) or clinical (r=0.04) examination marks.
- Students reported highly positive experiences, rating the learning experience (4.6/5), content appropriateness (4.4/5), and utility as an evaluation tool (4.1/5).
Conclusions:
- Anesthesia simulators demonstrate reliability as an assessment method for medical students.
- Further research may support integrating simulators into broader medical education and assessment strategies.
- The simulator shows potential for evaluating learning objectives across various medical disciplines.
