Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Quality assurance methods for performance-based assessments.

John R Boulet1, Danette W McKinley, Gerald P Whelan

  • 1Research and Evaluation, Educational Commission for Foreign Medical Graduates, 3624 Market Street, Philadelphia, PA 19104-2685, USA. jboulet@ecfmg.org

Advances in Health Sciences Education : Theory and Practice
|March 26, 2003
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The Use of COMLEX-USA Performance When Considering DO Applicants to General Surgery Residency Programs.

Journal of surgical education·2025
Same author

Assessing fundamental clinical skills of osteopathic medical students.

Journal of osteopathic medicine·2025
Same author

Does Physicians' Clinical Competence, Communication Ability, or Cultural Background Influence Potentially Inappropriate Prescribing of Benzodiazepines and Z-Drugs Among Older Adults With Insomnia?

Pharmacoepidemiology and drug safety·2024
Same author

A validity study of COMLEX-USA Level 3 with the new test design.

Journal of osteopathic medicine·2024
Same author

Comparison of Bedside and Video-Based Capillary Refill Time Assessment in Children.

Pediatric emergency care·2022
Same author

Comments on "Reported completion of the USMLE Step 1 and match outcomes among senior osteopathic students in 2020".

Journal of osteopathic medicine·2022
Same journal

Decision-making in programmatic assessment is only a challenge when we make it one.

Advances in health sciences education : theory and practice·2026
Same journal

Historicizing health professions education research: history as a strategic analytic resource.

Advances in health sciences education : theory and practice·2026
Same journal

Factors influencing workplace collaboration and learning between resident doctors and senior nurses: a scoping review.

Advances in health sciences education : theory and practice·2026
Same journal

Grave lessons: a guide to historiographical research in health professions education.

Advances in health sciences education : theory and practice·2026
Same journal

A scoping review of inquiry in medicine and nursing using Dewey's perspective.

Advances in health sciences education : theory and practice·2026
Same journal

"Teaching is important, but it's not important": a qualitative study of teacher identity among early-career academics in health professions.

Advances in health sciences education : theory and practice·2026
See all related articles

Quality assurance (QA) strategies are crucial for ensuring accurate scores in performance assessments like standardized patient (SP) examinations. Implementing robust QA measures enhances the validity and reliability of these critical evaluations.

Area of Science:

  • Medical Education
  • Health Professions Education
  • Assessment and Evaluation

Background:

  • Performance-based assessments, such as standardized patient (SP) examinations, are susceptible to numerous error sources.
  • Unchecked errors can significantly compromise the validity and reliability of assessment scores.
  • Quality assurance (QA) measures are essential for mitigating measurement error and ensuring score accuracy.

Purpose of the Study:

  • To outline effective QA strategies for identifying content- and score-related issues in SP assessments.
  • To provide practical guidance for improving the quality of performance-based evaluations.
  • To underscore the importance of rigorous QA in standardized patient examinations.

Main Methods:

  • Utilized case analyses to identify potential problems in SP assessments.

Related Experiment Videos

  • Employed comparisons of primary and observer scores for quality control.
  • Incorporated statistical methods and data interpretation examples from the ECFMG Clinical Skills Assessment (CSA).
  • Main Results:

    • Identified specific QA strategies applicable to SP assessments.
    • Demonstrated the utility of statistical analyses in detecting score-related problems.
    • Highlighted the impact of training and feedback on rater performance.

    Conclusions:

    • Well-defined training regimes are necessary for consistent rater performance.
    • Regular feedback to raters is vital for maintaining scoring accuracy.
    • Detailed statistical analyses are indispensable for validating assessment scores.