Four ways to get a grip on making robust decisions from workplace-based assessments

Area of Science:

• Medical Education
• Healthcare Professional Development
• Assessment and Evaluation

Background:

• Synthesizing workplace-based assessment (WBA) data for trainee progression decisions is crucial yet complex.
• Overemphasis on individual assessor performance can undermine robust collective decision-making.
• Difficulties arise in making definitive judgments, particularly concerning professionalism.

Purpose of the Study:

• To propose a systems-based model for synthesizing WBA results.
• To enhance the robustness of decisions regarding trainee progression.
• To effectively incorporate assessor judgment within a collective decision-making framework.

Main Methods:

• Development of a novel systems-based model for WBA data synthesis.
• Qualitative analysis of experiences applying the model in practice.
• Focus on integrating individual assessor insights into a broader evaluative system.

Main Results:

• The proposed model facilitates more robust decision-making in WBA synthesis.
• It effectively incorporates the value of assessor judgment.
• The model has proven useful in addressing complex areas like professionalism assessment.

Conclusions:

• A systems-based approach enhances the reliability of WBA for trainee progression.
• This model balances individual assessment with collective judgment for improved outcomes.
• It offers a practical solution for challenging assessment scenarios in professional development.