Jove
Visualize
Contact Us

Related Experiment Videos

A practice oral examination rating scale--inter-observer reliability

W O McCormick

    Canadian Journal of Psychiatry. Revue Canadienne De Psychiatrie
    |June 1, 1981
    PubMed
    Summary
    This summary is machine-generated.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Psychiatry--meeting the challenges: I am worried, I am encouraged.

    Canadian journal of psychiatry. Revue canadienne de psychiatrie·1995
    Same author

    Why another examination?

    CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne·1992
    Same author

    Have you heard?

    CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne·1989
    Same author

    Epidemiology of depression.

    Psychiatric journal of the University of Ottawa : Revue de psychiatrie de l'Universite d'Ottawa·1989
    Same author

    LB virus: neurotropic variant of Epstein-Barr virus?

    CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne·1988
    Same author

    Trivial pursuit at major medical conferences?

    CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne·1988
    Same journal

    Prevalence of Comorbid Postpartum Depression and Anxiety in Birthing Parents Seeking Treatment for Postpartum Depression: Prévalence de la présence comorbide de la dépression et de l'anxiété post-partum chez les parents ayant accouché qui ont consulté en raison de la dépression post-partum.

    Canadian journal of psychiatry. Revue canadienne de psychiatrie·2026
    Same journal

    Healthcare Pattern of Use Before and After Initiating a Long-Acting Antipsychotic Among a Cohort of 6221 Patients With a History of Psychosis.

    Canadian journal of psychiatry. Revue canadienne de psychiatrie·2026
    Same journal

    Clinician's Corner: Chatbots for Psychotherapy.

    Canadian journal of psychiatry. Revue canadienne de psychiatrie·2026
    Same journal

    Understanding Illicit Prescription Painkiller Use: A Multivariable Exploration of Mental Health and Other Predictors Among Canadian University Students: Comprendre la consommation illicite d'analgésiques sur ordonnance : une analyse multivariée de la santé mentale et d'autres facteurs prédictifs chez les étudiants universitaires canadiens.

    Canadian journal of psychiatry. Revue canadienne de psychiatrie·2026
    Same journal

    Update on ADHD genetics: A practitioner's perspective: Mise à jour sur la génétique du TDAH : le point de vue d'un praticien.

    Canadian journal of psychiatry. Revue canadienne de psychiatrie·2026
    Same journal

    Sexsomnia: A Clinical Entity Psychiatrists Should Know About.

    Canadian journal of psychiatry. Revue canadienne de psychiatrie·2026
    See all related articles
    JoVE
    x logofacebook logolinkedin logoyoutube logo
    ABOUT JoVE
    OverviewLeadershipBlogJoVE Help Center
    AUTHORS
    Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
    LIBRARIANS
    TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
    RESEARCH
    JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
    EDUCATION
    JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
    Terms & Conditions of Use
    Privacy Policy
    Policies

    Certified specialists showed significant rating disagreements in simulated clinical oral examinations, impacting pass/fail outcomes. Developing reliable assessment instruments is crucial for evolving certification standards.

    Area of Science:

    • Medical Education
    • Professional Assessment

    Background:

    • Certification examinations are critical for validating specialist competence.
    • Ensuring reliability and consistency in rater scoring is a persistent challenge in medical education.

    Purpose of the Study:

    • To evaluate the inter-rater reliability of scores in simulated clinical oral examinations.
    • To identify potential sources of variability and disagreement among raters in certification assessments.

    Main Methods:

    • Three videotaped practice clinical oral examinations were assessed.
    • A total of 29 certified specialists, involved in resident training, served as raters.
    • Raters evaluated the examinations, and scores were analyzed for consistency.

    Main Results:

    Related Experiment Videos

    • Considerable differences in rating scores were observed in two of the simulated examinations.
    • These score discrepancies led to disagreements on pass/fail status for candidates.
    • Potential examiner "contamination" or bias was noted as a factor influencing ratings.

    Conclusions:

    • Current rating practices for certification examinations exhibit significant variability.
    • The development of more reliable and standardized assessment instruments is urgently needed.
    • Addressing rater variability is essential as professional college policies for examinations evolve.