Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Testing internal consistency and construct validity during evaluation of performance in a patient simulator

J H Devitt1, M M Kurrek, M M Cohen

  • 1Department of Anaesthesia, Sunnybrook Health Science Centre, Toronto, Ontario, Canada. j.hugh_devitt@mail.magic.ca

Anesthesia and Analgesia
|June 10, 1998
PubMed
Summary

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Biofilm structures (EPS and bacterial communities) in drinking water distribution systems are conditioned by hydraulics and influence discolouration.

The Science of the total environment·2017
Same author

Genetic and morphological features of human iPSC-derived neurons with chromosome 15q11.2 (BP1-BP2) deletions.

Molecular neuropsychiatry·2015
Same author

Cardiac gene therapy in large animals: bridge from bench to bedside.

Gene therapy·2012
Same author

JNK modulates FOXO3a for the expression of the mitochondrial death and mitophagy marker BNIP3 in pathological hypertrophy and in heart failure.

Cell death & disease·2012
Same author

Hypercoagulability after trauma: hemostatic changes and relationship to venous thromboembolism.

Thrombosis research·2008
Same author

Linear width of the medial temporal lobe can discriminate Alzheimer's disease from normal aging: the Sunnybrook dementia study.

Neurobiology of aging·2004

This study developed a reliable patient simulator for evaluating anesthesiologist performance. The refined tool effectively distinguished between resident and staff anesthesiologists, demonstrating its validity in performance assessment.

Area of Science:

  • Medical Simulation
  • Anesthesiology Education
  • Performance Evaluation

Background:

  • Assessing anesthesiologist performance is crucial for patient safety.
  • Simulated patient environments offer a controlled setting for skill evaluation.
  • Existing rating systems require validation for accuracy and reliability.

Purpose of the Study:

  • To validate a rating system for anesthesiologist performance in a simulated environment.
  • To assess the system's ability to differentiate between resident and staff anesthesiologists.
  • To improve the reliability and validity of simulation-based assessments.

Main Methods:

  • Developed and tested a 10-item rating scale across two clinical scenarios.
  • Utilized a patient simulator with anesthesiology residents and faculty.

Related Experiment Videos

  • Calculated internal consistency using Cronbach's alpha and compared group scores with the Cochran-Mantel-Haenszel test.

    • Main Results:

    • Initial internal consistency (Cronbach's alpha) was low (0.27-0.28).
    • Removing four poorly performing items improved reliability to 0.66.
    • Faculty anesthesiologists achieved significantly higher scores than residents (P < 0.001).

    Conclusions:

    • A refined patient simulator-based evaluation process demonstrated acceptable reliability.
    • The instrument showed discriminant validity, distinguishing between experience levels.
    • This validated tool can enhance anesthesiology training and performance assessment.