Raising the bar: reassessing standards for procedural competence

Area of Science:

• Medical Education
• Clinical Skills Assessment
• Procedure Competency

Background:

• The optimal frequency for reevaluating clinical skills examination passing standards remains undetermined.
• This study addresses the need for periodic review of assessment benchmarks in medical training.

Purpose of the Study:

• To investigate whether enhanced resident performance influences the passing standard set by expert judges for clinical skills assessments.
• To determine the impact of cumulative performance data on the stringency of passing standards.

Main Methods:

• An expert panel established an initial passing standard for a central venous catheter insertion examination in 2006.
• Resident performance data from 2007-2010 were analyzed, and a new expert panel set a revised standard in 2010.
• Interrater and test-retest reliability were assessed, and passing standards from both years were compared.

Main Results:

• Expert judgments demonstrated reliable and stable performance.
• The revised passing standard increased significantly: 88% for internal jugular and 87% for subclavian catheter insertion, up from 79% in 2006.
• A clear upward trend in trainee scores preceded the standard revision.

Conclusions:

• Accumulated resident performance data prompted experts to implement a more demanding minimum passing standard.
• Regular review and adjustment of clinical skills examination standards are crucial for maintaining fairness and rigor.
• This study highlights the dynamic nature of competency assessment in medical education.