Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

The validity of performance assessments using simulation.

J H Devitt1, M M Kurrek, M M Cohen

  • 1Department of Anaesthesia, University of Toronto, Sunnybrook and Women's College Health Sciences Centre, Ontario, Canada. exhd@qe2-hsc.ns.ca

Anesthesiology
|July 24, 2001
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Efficacy of high-fidelity simulation debriefing on the performance of practicing anaesthetists in simulated scenarios.

British journal of anaesthesia·2009
Same author

High-fidelity patient simulation: validation of performance checklists.

British journal of anaesthesia·2004
Same author

Comparison between medical students' experience, confidence and competence.

Medical education·2002
Same author

A comparison of global ratings and checklist scores from an undergraduate assessment using an anesthesia simulator.

Academic medicine : journal of the Association of American Medical Colleges·2001
Same author

A Canadian simulation experience: faculty and student opinions of a performance evaluation study.

British journal of anaesthesia·2000
Same author

Inadequate preanesthesia equipment checks in a simulator.

Canadian journal of anaesthesia = Journal canadien d'anesthesie·2000
Same journal

The Time-out.

Anesthesiology·2026
Same journal

Evaluation of Post-block Hypersensitivity Using Quantitative Sensory Testing Before, During, and After Axillary Brachial Plexus Block Resolution in Healthy Volunteers.

Anesthesiology·2026
Same journal

The state of medical education research in Anesthesiology: Current landscape and future directions - An initiative of the Anesthesia Research Council.

Anesthesiology·2026
Same journal

Diagnostic Ultrasound-guided Focused Ultrasound-induced Noninvasive, Reversible Peripheral Nerve Blockade in an In Vivo Model of Acute Pain: A Proof-of-Concept Study.

Anesthesiology·2026
Same journal

S-Ketamine Reduces Risk of Postoperative Delirium: Comment.

Anesthesiology·2026
Same journal

Computed Tomography-Based Body Composition Assessment for Preoperative Cardiovascular Risk Prediction: A Prospective Cohort Study.

Anesthesiology·2026
See all related articles

Simulator-based anesthesia evaluation demonstrates construct validity and high realism. Performance varied significantly across anesthesiologist groups and trainees, but realism ratings were consistently high.

Area of Science:

  • Medical Education
  • Anesthesiology
  • Simulation-Based Training

Background:

  • Assessing clinical performance in anesthesiology is crucial.
  • Simulator-based evaluation offers a potential method for objective assessment.
  • Understanding participant perception of realism is key to validating simulation use.

Purpose of the Study:

  • To determine if a simulator-based evaluation can demonstrate construct validity.
  • To assess the realism of the simulation experience for participants.
  • To differentiate performance levels among anesthesiologists and trainees.

Main Methods:

  • 33 university-based anesthesiologists, 46 community-based anesthesiologists, 23 residents, and 37 medical students participated.
  • A simulation involved patient evaluation, anesthesia induction, and maintenance, scored on a 0-2 scale.

Related Experiment Videos

  • Participants rated the realism of the simulation on a 10-point visual analog scale (VAS).

    • Main Results:

    • A seven-item scenario showed significant differences in mean scores across groups (P < 0.0001).
    • University anesthesiologists (0.53) and residents (0.54) scored higher than community anesthesiologists (0.38) and medical students (0.15).
    • The overall realism VAS score was 7.8, with no correlation between simulator score and realism (R = -0.07).

    Conclusions:

    • Simulator-based evaluation effectively discriminated between anesthesiology practice categories, confirming construct validity.
    • High realism ratings suggest participant comfort did not significantly influence performance.
    • The method shows promise for evaluating clinical competence in anesthesiology.