Developing a dashboard to meet the needs of residents in a competency-based training program: A design-based research...

Area of Science:

• Medical Education
• Competency-Based Medical Education (CBME)
• Educational Technology

Background:

• Canadian specialty programs are adopting Competence By Design (CBME), a competency-based medical education framework.
• CBME necessitates frequent assessment of entrustable professional activities, generating large volumes of data.
• Effective interpretation of CBME assessment data by residents is crucial for learning, yet support for data visualization and interaction is limited.

Purpose of the Study:

• To determine optimal presentation of Competence By Design assessment data for resident learning.
• To develop an interactive dashboard tailored to the needs of emergency medicine residents at the University of Saskatchewan.

Main Methods:

• A design-based research process was employed to identify and address resident needs.
• Four focus groups with emergency medicine residents at the University of Saskatchewan were conducted over 10 months.
• Grounded theory analysis of focus group discussions informed the development of a dashboard with data, analytics, and visualizations.

Main Results:

• Resident needs were categorized into three main themes: guidance on the assessment program, presentation of workplace-based assessment data, and presentation of other assessment data.
• Seventeen distinct dashboard elements were designed to address the identified resident needs.
• The developed dashboard incorporates visualizations and analytics to facilitate data interpretation.

Conclusions:

• The design-based research successfully identified resident needs for Competence By Design assessment data presentation.
• Specific dashboard elements were created to meet these identified needs, enhancing resident learning.
• This study provides a foundation for creating and refining CBME assessment dashboards to support resident education.