Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Improving resident performance assessment data: numeric precision and narrative specificity.

John H Littlefield1, Debra A Darosa, Judy Paukert

  • 1University of Texas Health Science Center at San Antonio, Academic Informatics Services, 78229-3900, USA. littlefield@uthscsa.edu

Academic Medicine : Journal of the Association of American Medical Colleges
|April 27, 2005
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Building on Strengths: An Affirmational and Systems-Level Approach to Revisiting Character in Medicine.

Academic medicine : journal of the Association of American Medical Colleges·2024
Same author

ASPIRE-ing to Excellence at SIUSOM.

MedEdPublish (2016)·2024
Same author

The APGO Academic Scholars and Leaders Program: Supporting obstetrics and gynecology faculty development for 20 years.

Medical teacher·2023
Same author

A Grant-Based Experiment to Train Clinical Investigators: The AACR/ASCO Methods in Clinical Cancer Research Workshop.

Clinical cancer research : an official journal of the American Association for Cancer Research·2021
Same author

Southern Illinois University School of Medicine.

Academic medicine : journal of the Association of American Medical Colleges·2021
Same author

A Proposed Blueprint for Operative Performance Training, Assessment, and Certification.

Annals of surgery·2020

A systems approach improved surgical residency performance assessments by enhancing data quality. This involved refining rating scores and narrative comments through better feedback loops.

Area of Science:

  • Medical Education
  • Surgical Training
  • Quality Improvement

Background:

  • Performance assessment in surgical residencies is crucial for training.
  • Existing methods may lack numeric precision and behavioral specificity.
  • Systems approaches can identify and address these assessment challenges.

Purpose of the Study:

  • To evaluate a systems approach for diagnosing performance assessment problems in surgery residencies.
  • To improve the numeric precision of global rating scores.
  • To enhance the behavioral specificity of narrative comments in resident evaluations.

Main Methods:

  • Two surgery programs conducted parallel before-and-after trials.
  • Quality assurance data were collected, and problems were identified during a baseline year.

Related Experiment Videos

  • An educational specialist implemented organizational change strategies to improve feedback loops over two intervention years.
  • Analyzed were form return rates, generalizability coefficients, confidence intervals, and narrative comment specificity.

    • Main Results:

    • Form return rates significantly increased to 100% at both sites.
    • Generalizability coefficients improved at both sites (Site A: 0.65 to 0.85; Site B: 0.58 to 0.79).
    • Behaviorally specific narrative comments increased significantly at both sites (Site A: 50% to 82%; Site B: 50% to 67%).

    Conclusions:

    • A systems approach effectively diagnosed performance assessment problems in surgical residencies.
    • Improving information feedback loops enhanced the quality of resident performance assessment data.
    • The study demonstrated measurable improvements in assessment data quality.