Factors in faculty evaluation of medical students' performance
Andrew R Pulito1, Michael B Donnelly, Margaret Plymale
1Department of Surgery, College of Medicine, University of Kentucky, Lexington, Kentucky, USA. arpuli@uky.edu
Context:
Faculty members often use global rating scales as a method of assessing various characteristics of medical students' clinical performance. The purpose of this study was to determine if some performance characteristics are more highly associated with the overall faculty grade than others.
Methods:
The clinical performance of 211 surgery clerkship students was evaluated by 2 or 3 faculty preceptors. Faculty rated students on 10 specific performance characteristics, using a 5-point scale. Faculty then assigned a numerical grade summarising the faculty's view of the student's performance. Reliability of the ratings was estimated by the intraclass correlation, and 1-way (analysis of variance) anova was used to test for differences among the students' mean ratings. Logistic regression was employed to determine the accuracy of each performance measure in predicting students' grades (A or B). Stepwise logistic regression was used to determine if there was a combination of performance characteristics that best predicted students' grades.
Results:
The inter-rater reliabilities were low (
Conclusions:
The rating on any single characteristic predicts a student's overall grade very accurately. Additional measures do not greatly increase the accuracy of prediction. Our results suggest that faculty make a relatively undifferentiated judgement in assigning student grades, and there is little to be gained by using multi-item forms in assessing medical students' clinical performance.
Related Concept Videos
Nursing Evaluation
Section...
Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning, patient...
Factors affecting Blood pressure
Physiological Factors:
Reliability and Validity
Social Foundations of Self III: Self-Evaluation
Factors Affecting Drug Response: Overview
