Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

How specific is case specificity?

Geoffrey Norman1, Georges Bordage, Gordon Page

  • 1Health Sciences Centre, McMaster University, Hamilton, Ontario, Canada. norman@mcmaster.ca

Medical Education
|July 14, 2006
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Utility of multi-spline multi-electrode 3D mapping catheters in idiopathic outflow ventricular tachycardia.

Irish journal of medical science·2026
Same author

The Clinical Utility of 3D Electroanatomical Mapping for Atrial Fibrillation Ablation by Pulsed Field Ablation.

Journal of arrhythmia·2025
Same author

The 'Reducing Psychosis Risk by Targeting Trauma' Trial: Protocol of a Feasibility Randomised Controlled Trial of Trauma-Focused Cognitive Behavioural Therapy and Eye Movement Desensitisation and Reprocessing Therapy for People With At-Risk Mental States.

Early intervention in psychiatry·2025
Same author

Posttransplant diabetes mellitus and long-term outcomes after kidney transplantation in a steroid avoidance regimen: a cohort study.

BMC nephrology·2025
Same author

Longitudinal patterns of fluid overload, blood volume and vascular refilling: a prospective study in patients on maintenance hemodialysis.

Clinical kidney journal·2025
Same author

BioImpedance Spectroscopy to maintain Renal Output: the BISTRO randomised controlled trial.

Health technology assessment (Winchester, England)·2025
Same journal

When I say … 'in situ simulation'.

Medical education·2026
Same journal

Examiner training and calibration for simulated clinical examinations: A scoping review.

Medical education·2026
Same journal

When systems set the limits of supervision.

Medical education·2026
Same journal

From psychometrics to partnerships: Broadening what counts as validity evidence.

Medical education·2026
Same journal

When I say the clinical digital divide.

Medical education·2026
Same journal

Urology education under fire: Quantitative benchmarking of trainer adaptation and competency preservation in wartime Sudan.

Medical education·2026
See all related articles

Error variance in case-based medical exams primarily stems from items within cases, not the cases themselves. Optimizing test reliability involves using 2-3 questions per case for better performance measurement.

Area of Science:

  • Medical Education Research
  • Psychometrics
  • Assessment Design

Background:

  • Case specificity suggests performance varies by case.
  • Understanding error variance sources is crucial for reliable case-based examinations.
  • Optimizing test structure maximizes reliability within time constraints.

Purpose of the Study:

  • To determine the proportion of error variance attributable to differences between cases versus items within cases.
  • To identify the optimal number of items per case to maximize test reliability.
  • To analyze the impact of test composition on reliability in case-based assessments.

Main Methods:

  • Generalizability (G) and Decision (D) studies were employed.
  • Variance components and reliability were analyzed for three Medical Council of Canada examinations.

Related Experiment Videos

  • Test compositions with 1 to 5 items per case were evaluated.

    • Main Results:

    • Subject variance was the smallest component.
    • Subject-item interaction variance (0.1106) significantly exceeded subject-case interaction variance (0.0195).
    • Approximately 80% of error variance originated from item variability within cases; reliability ranged from 0.541 to 0.579, peaking with 2-3 items per case.

    Conclusions:

    • Items within cases, rather than cases themselves, are the primary source of error variance.
    • Utilizing 2-3 items per case is the optimal strategy for enhancing examination reliability.
    • This finding informs the design of more dependable case-based medical assessments.