Related Experiment Video
Updated: Aug 7, 2026
Setup and Execution of the Rapid Cycle Deliberate Practice Death Notification Curriculum
Published on: August 5, 2020
A comparison of anesthesiology resident and faculty electronic evaluations before and after implementation of
James M Blum1, Sachin Kheterpal, Kevin K Tremper
1Department of Anesthesiology, University of Michigan, Ann Arbor, MI 48109, USA. jmblum@med.umich.edu
Study Objective:
To develop an automated e-mail reminder system to contact residents and faculty regarding incomplete evaluations. DESIGN, SETTING, INTERVENTION, AND MEASUREMENTS: In the retrospective study, two 9-month periods were evaluated representing pre- and post-introduction of the automated e-mail reminder system. Data collected contained the number of evaluations completed and the rating of residents and faculty at the University of Michigan Health System in 5 different categories on a 5-point scale.
Main Results:
The use of electronic reminders resulted in a nearly 4-fold increase in the number of resident evaluations by faculty from 1050 to 3761. Faculty completing evaluations increased from 40 (61%) to 66 (100%). The mean evaluation scores showed statistically significant but clinically negligible change for resident judgement, interpersonal skills, and intraoperative management. Resident preoperative evaluation and knowledge did not show statistically significant changes. Residents completing evaluations of faculty increased from 244 to 1798, and the number of residents completing evaluations rose from 40 (56%) to 87 (100%). There were no statistically significant changes in the evaluation of faculty except in the category of feedback.
Conclusion:
An automated e-mail reminder system implemented to contact residents and faculty regarding incomplete evaluations for residents and faculty dramatically enhanced participation in the evaluation process.