Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

A model for setting performance standards for standardized patient examinations.

Gregg Talente1, Steven A Haist, John F Wilson

  • 1Brody School of Medicine, East Carolina University, USA.

Evaluation & the Health Professions
|November 25, 2003
PubMed
Summary

This study presents a practical model for setting performance standards in complex standardized patient examinations. The iterative approach reduced rating variance and judges expressed confidence in the useful, reliable standards established.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Who declines "opt-out" HIV/HCV testing? Experience of an internal medicine resident continuity clinic serving a predominantly Black adult population in South Carolina.

Journal of the National Medical Association·2024
Same author

Which Internal Medicine Clerkship Characteristics Are Associated With Students' Performance on the NBME Medicine Subject Exam? A Multi-Institutional Analysis.

Academic medicine : journal of the Association of American Medical Colleges·2020
Same author

Intentions of Kentucky School Nurses to Delegate Diabetes-Related Tasks to Unlicensed Assistive Personnel.

The Journal of school nursing : the official publication of the National Association of School Nurses·2019
Same author

A Guide for Increasing Scholarship for Medical Educators.

Journal of general internal medicine·2019
Same author

Crowdsourcing for assessment items to support adaptive learning.

Medical teacher·2018
Same author

Performance on the Nephrology In-Training Examination and ABIM Nephrology Certification Examination Outcomes.

Clinical journal of the American Society of Nephrology : CJASN·2018

Area of Science:

  • Medical Education
  • Assessment Science
  • Psychometrics

Background:

  • Setting performance standards for complex assessments, such as standardized patient examinations, presents significant challenges.
  • Reliable and valid standards are crucial for accurate evaluation of trainee competency.

Purpose of the Study:

  • To describe and evaluate a model for setting performance standards for standardized patient examinations.
  • To assess the impact of an iterative standard-setting process on judge ratings and confidence.

Main Methods:

  • A modified Angoff procedure was adapted for a standardized patient exercise.
  • An iterative process was employed to refine performance standards.
  • Evaluation focused on the impact of iteration, classification accuracy, judge confidence, and process practicality.

Related Experiment Videos

Main Results:

  • Iterative steps in the procedure led to a reduction in variance among judges' ratings.
  • All seven judges reported high confidence in the final performance standards.
  • The process was deemed practical, with a mean time commitment of 4.7 work hours per judge.

Conclusions:

  • The developed model successfully established useful and practical performance standards for the standardized patient examination.
  • This model is adaptable for setting performance standards in other similar assessment contexts.