The validity of clerkship performance evaluations.

Area of Science:

• Medical Education Research
• Clinical Performance Assessment
• Graduate Medical Education

Background:

• Narrative evaluations are used in medical school to assess clinical performance.
• The predictive validity of these evaluations for future residency performance requires further investigation.
• Residency supervisor ratings serve as a key criterion for evaluating medical school performance.

Purpose of the Study:

• To investigate the validity of narrative evaluations of clinical performance from medical school.
• To examine the association between medical school teacher evaluations and residency supervisor ratings.
• To identify dimensions of performance predicted by medical school evaluations.

Main Methods:

• Longitudinal study of three medical school graduate classes.
• Bivariate correlational, multiple regression, and canonical redundancy analyses were employed.
• Comparison of teacher evaluations during clerkships with supervisor ratings one year into residency.

Main Results:

• Canonical analysis revealed two significant relationships between evaluation sets (lambda 1 = 0.54, lambda 2 = 0.47).
• A dimension of overall competence in medicine and a dimension of interpersonal skills/professional maturity were identified.
• Medical school clerkship performance accounted for 15% of the variance in residency ratings.

Conclusions:

• Narrative evaluations from medical school show some predictive validity for residency performance.
• The findings underscore the importance of assessing interpersonal skills and professional maturity.
• There is a need to enhance the methods for evaluating professional behavior and maturity during medical school.