Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Content specificity and oral certification exams

J Turnbull1, D Danoff, G Norman

  • 1University of Ottawa, Faculty of Health Sciences, Ontario, Canada.

Medical Education
|January 1, 1996
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Modelling the role of enzymatic pathways in the metabolism of docosahexaenoic acid by monocytes and its association with osteoarthritic pain.

Mathematical biosciences·2024
Same author

Prevalence of frailty and its association with lifestyle factors among elderly in rural Bengaluru.

Journal of family medicine and primary care·2022
Same author

Properties of aqueous 1,4-dioxane solution via molecular dynamics.

The Journal of chemical physics·2021
Same author

Effectiveness of an mHealth application to improve hypertension health literacy in India.

International nursing review·2020
Same author

Effectiveness of psychosocial interventions for the prevention and treatment of foot ulcers in people with diabetes: a systematic review.

Diabetic medicine : a journal of the British Diabetic Association·2020
Same author

Psychosocial and behavioural prognostic factors for diabetic foot ulcer development and healing: a systematic review.

Diabetic medicine : a journal of the British Diabetic Association·2020
Same journal

Channelling Socrates to re-imagine asynchronous online learning.

Medical education·2026
Same journal

Moving beyond tokenism: A structured and intentional approach to embedding health advocacy in medical education.

Medical education·2026
Same journal

When I say … 'in situ simulation'.

Medical education·2026
Same journal

Examiner training and calibration for simulated clinical examinations: A scoping review.

Medical education·2026
Same journal

When systems set the limits of supervision.

Medical education·2026
Same journal

From psychometrics to partnerships: Broadening what counts as validity evidence.

Medical education·2026
See all related articles

The oral certification examination in Internal Medicine showed low generalizability across sessions, indicating inconsistent skill assessment. This impacts overall test reliability, suggesting a need for improved examination strategies.

Area of Science:

  • Medical Education
  • Professional Certification
  • Internal Medicine Training

Background:

  • Oral examinations are crucial for certifying physicians.
  • Assessing physician skills requires reliable and valid examination methods.
  • The Royal College of Physicians and Surgeons of Canada uses oral exams for Internal Medicine certification.

Purpose of the Study:

  • To evaluate the generalizability of skills assessed in the 1992 Internal Medicine oral certification examination.
  • To determine inter-rater reliability, session correlation, and overall test reliability.
  • To identify issues affecting the consistency of the examination.

Main Methods:

  • Prospective analysis of 1992 examination assessments.
  • Calculation of inter-rater reliability coefficients.

Related Experiment Videos

  • Assessment of correlation between morning and afternoon examination sessions.
  • Determination of overall test reliability and reliability after score categorization.

    • Main Results:

    • Inter-rater reliability was acceptable, consistent with prior research.
    • Generalizability across examination sessions was low (0.30-0.47), suggesting content specificity.
    • Overall test reliability was consequently low (0.57-0.69).
    • Categorizing scores into pass/borderline/fail further reduced test reliability.

    Conclusions:

    • The oral certification examination in Internal Medicine exhibits low generalizability and overall reliability.
    • Content specificity across sessions is a likely cause of low generalizability.
    • Strategies to enhance examination consistency and reliability are necessary.