Reconceptualizing variable rater assessments as both an educational and clinical care problem

Area of Science:

• Medical Education
• Healthcare Quality Improvement
• Clinical Supervision

Background:

• Public demand for accountability in U.S. healthcare and medical education.
• Competency-based training emphasizes accurate assessment and feedback for clinical skills.
• Variability exists in faculty assessments of trainee performance during patient encounters, often viewed as a rater cognition issue.

Purpose of the Study:

• To reframe the challenges in faculty assessment as both an educational and clinical care problem.
• To highlight the implications of assessment variability on trainee supervision and patient care quality.
• To propose a new framework for workplace-based assessments focused on safe, effective, patient-centered care.

Main Methods:

• Conceptual analysis and reconceptualization of assessment problems in medical education.
• Development of the Accountable Assessment for Quality Care and Supervision equation.
• Emphasis on shifting the frame of reference for performance ratings.

Main Results:

• Variable assessment quality impacts clinical supervision decisions and patient care.
• The proposed framework emphasizes patient safety as the core metric for assessment.
• A new conceptual model for assessment is introduced, highlighting the clinician educator's role.

Conclusions:

• Assessment variability is not solely a psychometric issue but a critical patient care concern.
• The Accountable Assessment for Quality Care and Supervision model underscores the complexity of supervision.
• Rethinking assessment necessitates new faculty development models and reinforces the clinician educator's vital role.