A novel, web-based application for assessing and enhancing practice-based learning in surgery residency

Area of Science:

• Medical Education
• Surgical Training
• Healthcare Informatics

Background:

• Practice-Based Learning and Improvement (PBLI) is a core competency for medical residents, mandated by the Accreditation Council for Graduate Medical Education (ACGME).
• Current assessment methods for resident PBLI, like portfolios and faculty evaluations, are often subjective and qualitative.
• There is a need for objective, quantitative, and outcome-based tools to evaluate resident performance and PBLI.

Purpose of the Study:

• To develop and evaluate a web-based application for assessing surgical residents' Practice-Based Learning and Improvement (PBLI).
• To provide objective, quantitative data on resident performance for accreditation and educational purposes.
• To facilitate resident self-assessment and identify areas for targeted learning.

Main Methods:

• A web-based application was implemented in a general surgery residency program.
• Senior residents documented patient consultations, their initial impressions, and plans in real-time.
• Patient outcomes were recorded, allowing residents to self-assess the accuracy of their initial assessments and calculate a performance metric (batting average).

Main Results:

• Seven senior residents participated, documenting 459 consultations (222 by PGY4, 237 by PGY5).
• PGY4 residents showed progressive improvement in their batting average (BA) from 82.9% to 94.3% over four quarters.
• PGY5 residents maintained a high BA, ranging from 93.8% to 96.4% throughout their documented period.

Conclusions:

• A web-based outcome-tracking program offers a valuable method for evaluating resident PBLI.
• The system provides rapid, ongoing assessment, generating objective data for accreditation.
• It aids in identifying individual resident knowledge gaps, promoting self-assessment, and guiding targeted learning.