Medical Student Performance Evaluations in 2005: an improvement over the former dean's letter?

To collect information regarding preparation, content, and format of Medical Student Performance Evaluations (MSPEs) and evaluate a sample of 2005 MSPEs to assess compliance with the 2002 Association of American Medical Colleges-issued MSPE guidelines.

Cross-sectional survey with all 126 U.S. allopathic medical schools. Associate deans of students affairs were sent an eight-item questionnaire in June 2006 and asked to submit a sample of redacted MSPEs for 2005 graduates, choosing one from each tertile of the class. Survey data are summarized. MSPEs were abstracted, and results are presented descriptively.

The survey response rate was 84%. Most associate deans (71%) reported having primary responsibility for composing MSPEs; 78% adhered to the format and content guidelines three fourths of the time. The abstraction of 293 MSPEs (78%) showed that more than 80% adhered to format recommendations. However, only 70% to 80% stated grades clearly, avoided the word recommendation, and stated whether the student had completed remediation. Fewer than 70% indicated whether the student had had any adverse actions or provided adequate comparative data. Strikingly, only 17% provide comparative data in the summary paragraph. Overall, 75% of the MSPEs were judged to be "adequate."

MSPEs are somewhat variable in terms of which specific items are included. There has been steady quality improvement since prior surveys, primarily in formatting and labeling. However, a sizable minority of writers are still using the MSPE as a recommendation, and too few are providing helpful comparative data.