Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Are multiple objective measures of student performance necessary?

David J Minion1, Michael B Donnelly, Rhonda C Quick

  • 1Department of Surgery, University of Kentucky Medical Center, 800 Rose St., Lexington, KY 40536-0084, USA. djmini@pop.uky.edu

American Journal of Surgery
|July 4, 2002
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

10-Year Outcomes of SAPIEN 3 Transcatheter Aortic Valve Replacement or Surgery in Intermediate-Risk Patients.

Journal of the American College of Cardiology·2026
Same author

VAL-083 is effective in patients with newly-diagnosed MGMT-unmethylated glioblastoma: report of phase II study.

Discover oncology·2025
Same author

Heterologous cAd3-Ebola and MVA-EbolaZ vaccines are safe and immunogenic in US and Uganda phase 1/1b trials.

NPJ vaccines·2024
Same author

Lysis and covered endovascular reconstruction of the aortic bifurcation (LA CERAB) technique for chronic juxtarenal aortic occlusions.

The Journal of cardiovascular surgery·2023
Same author

Comparison of Low-Value Services Among Medicare Advantage and Traditional Medicare Beneficiaries.

JAMA health forum·2022
Same author

Comparison of Health Care Utilization by Medicare Advantage and Traditional Medicare Beneficiaries With Complex Care Needs.

JAMA health forum·2022

A complex medical student evaluation model showed improved reliability over a traditional one. However, both methods ranked students similarly, indicating neither fully captures all assessment data.

Area of Science:

  • Medical Education
  • Assessment Methods
  • Student Evaluation

Background:

  • Evaluating medical students' competency is crucial for patient safety.
  • Traditional assessment models may not capture the full spectrum of student abilities.
  • The need for more comprehensive and reliable evaluation tools is recognized.

Purpose of the Study:

  • To compare the reliability and effectiveness of a complex, multi-modal student evaluation model against a traditional one.
  • To determine if a complex model provides a more nuanced assessment of medical student performance.

Main Methods:

  • A cohort of 34 medical students was assessed using a complex model incorporating NBME shelf exams, OSCE, CPS, and faculty/peer evaluations.
  • A traditional model using only NBME and faculty evaluations served as a comparison.

Related Experiment Videos

  • Reliability (coefficient alpha) and item correlations were calculated for both models.

    • Main Results:

    • The complex model demonstrated higher reliability (0.72) compared to the traditional model (0.47).
    • National Board of Medical Examiners (NBME) shelf examinations were the most discriminating assessment, followed by Objective Structured Clinical Examination (OSCE).
    • Despite reliability differences, both models produced similar student rank orders (Spearman's rho = 0.87).

    Conclusions:

    • While the complex evaluation model enhances reliability, it does not significantly alter student ranking compared to traditional methods.
    • Neither the complex nor the traditional model fully integrates the information from all individual assessment components.
    • Further refinement of multi-modal assessment strategies is needed to comprehensively capture student performance.