Developing a Competency-Based Learning and Assessment System for Residency Training: Analysis Study of User...

Area of Science:

• Medical Education Technology
• Competency-Based Medical Education (CBME)
• Digital Health Platforms

Background:

• The complexity of modern healthcare necessitates robust systems for competency-based medical education (CBME).
• Effective management and synthesis of assessment data are crucial for CBME, requiring digital solutions.
• Systems facilitating real-time feedback are vital for in-situ learning and coaching in clinical settings.

Purpose of the Study:

• To develop an electronic platform system for competency-based learning and assessment tailored for resident physicians.
• To enhance trainee learning experiences through integrated clinical assessments.
• To reduce the administrative burden associated with resident assessments.

Main Methods:

• Design, development, and evaluation of a Competency-Based Learning and Assessment System (CBLAS).
• Needs assessments conducted via opinion interviews and focus groups with trainees, clinical teachers, and staff.
• Surveys assessing clinical teachers' acceptance of CBME assessments and overall user satisfaction with the CBLAS.

Main Results:

• The CBLAS was designed based on nine themes identified from user needs assessments.
• A significant improvement in clinical teachers' attitudes towards CBME assessments was observed post-implementation (P=.02).
• 87.2% of users reported satisfaction with the CBLAS, citing positive information, system, and service qualities.

Conclusions:

• The CBLAS is a user-centered platform supporting assessments, learning, and administration in residency training.
• The system fosters a more positive attitude among clinical teachers towards milestones and EPAs.
• The CBLAS provides a model for developing digital systems to execute milestone- and EPA-based assessments for CBME.