Where Are We and Where Are We Going? A GME Program Scorecard for Continuous Programmatic Improvement

Area of Science:

• Medical Education
• Health Informatics
• Data Visualization

Background:

• Graduate medical education (GME) leaders struggle with evaluating program performance due to fragmented data and limited resources.
• Existing dashboard solutions often lack scalability, participant input, or feasibility without new infrastructure.

Purpose of the Study:

• To develop and implement a centralized, participant-informed GME Program Scorecard (GPS).
• To enable continuous GME program evaluation and improvement using existing data systems without requiring new data entry.

Main Methods:

• A consensus development panel identified 42 candidate metrics, with program directors prioritizing 17 key metrics.
• A Tableau-based dashboard was developed and piloted with 4 residency programs.
• Feedback from pilot users informed design refinements before institutional launch.

Main Results:

• 92.9% of metrics received a mean score indicating high priority.
• Pilot users reported high acceptability of the GPS.
• Development required 2920 analyst hours and $1,600 in licenses.

Conclusions:

• The GME Program Scorecard (GPS) is a feasible tool for continuous program evaluation.
• The GPS demonstrated significant user adoption, with 61.4% of potential users accessing the dashboard within 22 months of launch.
• The project required modest resources, highlighting the efficiency of leveraging existing data systems.