Trainee anaesthetist self-assessment using an entrustment scale in workplace-based assessment

Area of Science:

• Medical Education
• Anaesthesiology
• Workplace-Based Assessment

Background:

• Self-assessment is crucial for anaesthesia trainees but its role in workplace-based assessment is debated.
• Entrustment scales enhance supervisor consensus on performance standards.
• This study investigates if entrustment scales improve trainee self-assessment accuracy.

Purpose of the Study:

• To determine if an entrustment scale enhances anaesthesia trainees' self-assessment accuracy.
• To assess the agreement between trainee and supervisor ratings using the entrustment scale.
• To explore factors influencing rating discrepancies.

Main Methods:

• 113 anaesthesia trainee-supervisor pairs completed mini-clinical evaluation exercises.
• Pearson and intraclass correlation coefficients calculated trainee-supervisor rating agreement.
• Narrative comments analyzed for factors influencing ratings.

Main Results:

• 32% of ratings agreed exactly; 66% were within one point on a nine-point scale.
• Correlation coefficient was 0.71; intraclass correlation coefficient was 0.67.
• Trainee rating correlation improved with higher supervisor ratings; no strong demographic associations found.

Conclusions:

• The entrustment scale facilitates a shared understanding of performance standards between trainees and supervisors.
• Concordance suggests the scale aids trainees in self-assessment.
• Discussion on rating rationale can further enhance shared understanding.