Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Detecting score drift in a high-stakes performance-based assessment.

Danette W McKinley1, John R Boulet

  • 1Research and Evaluation, Educational Commission for Foreign Medical Graduates, 3624 Market Street, 4th Floor, Philadelphia, PA 19104, USA. dmckinley@ecfmg.org

Advances in Health Sciences Education : Theory and Practice
|January 24, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The Use of COMLEX-USA Performance When Considering DO Applicants to General Surgery Residency Programs.

Journal of surgical education·2025
Same author

Assessing fundamental clinical skills of osteopathic medical students.

Journal of osteopathic medicine·2025
Same author

Does Physicians' Clinical Competence, Communication Ability, or Cultural Background Influence Potentially Inappropriate Prescribing of Benzodiazepines and Z-Drugs Among Older Adults With Insomnia?

Pharmacoepidemiology and drug safety·2024
Same author

A validity study of COMLEX-USA Level 3 with the new test design.

Journal of osteopathic medicine·2024
Same author

Comparison of Bedside and Video-Based Capillary Refill Time Assessment in Children.

Pediatric emergency care·2022
Same author

Comments on "Reported completion of the USMLE Step 1 and match outcomes among senior osteopathic students in 2020".

Journal of osteopathic medicine·2022

Detecting score drift in standardized patient examinations (SPE) is crucial for maintaining assessment fairness. This study explored methods to identify changes in case difficulty over time, ensuring score comparability in high-stakes evaluations.

Area of Science:

  • Medical Education
  • Psychometrics
  • Assessment Science

Background:

  • Standardized patient examinations (SPE) are vital for performance-based assessments in healthcare education.
  • Ensuring score comparability across different test forms and over time is a significant psychometric challenge.
  • Limited research exists on detecting case difficulty drift in large-scale SPE.

Purpose of the Study:

  • To investigate a procedure for detecting drift in difficulty estimates for a large-scale, high-stakes SPE.
  • To address the challenge of maintaining score comparability in performance-based assessments.

Main Methods:

  • Utilized a procedure to monitor case difficulty estimates over time.
  • Analyzed mean score variations for specific performance tasks within the SPE.

Related Experiment Videos

  • Focused on a large-scale, high-stakes standardized patient examination.

    • Main Results:

    • Identified variation in mean scores over time for particular performance tasks.
    • Demonstrated the feasibility of creating a case-SP mean bank for score linking.
    • Highlighted the necessity of rigorous standardization of examination materials.

    Conclusions:

    • Detecting and addressing score drift in SPE is feasible and essential.
    • Continuous monitoring and standardization of assessment materials are critical for score comparability.
    • Ensuring score comparability safeguards the integrity of pass-fail decisions in high-stakes evaluations.