Residency evaluations. Are they worth the effort?

Area of Science:

• Medical Education Research
• Surgical Training Assessment
• Resident Performance Evaluation

Background:

• Clinical performance ratings are vital for assessing resident competence in surgical training.
• The predictive accuracy of rotation evaluation forms in general surgery residencies requires thorough investigation.

Purpose of the Study:

• To assess the accuracy of rotation evaluation forms in predicting general surgery resident competence.
• To determine the usefulness of clinical performance ratings in residency training.

Main Methods:

• A longitudinal, 15-year study involving 310 general surgery and subspecialty residents.
• Analysis of 6459 rotation evaluations, with a focus on 4423 evaluations from 199 residents.
• Outcome measures included categorization and ranking of resident competence by attending surgeons.

Main Results:

• Rotation evaluations successfully identified 77.8% of residents who involuntarily withdrew from the program.
• Evaluations predicted resident outcome categories (problem, average, superior) and final ranking (R2 = .54, P < .001).
• Early evaluations, from the first year onward, demonstrated predictive power for end-of-training outcomes (P < .01).

Conclusions:

• Rotation evaluations possess significant predictive validity for documenting resident performance in general surgery.
• The accuracy of individual raters is a key factor in enhancing the predictive power of these evaluations.