Identification of teaching excellence in operating room and clinic settings

A system for obtaining learner feedback on surgical faculty teaching is a program-specific resource for recognizing faculty accomplishments as well as being a requirement of the Accreditation Council for Graduate Medical Education (ACGME). This investigation uses 5 years of feedback from residents to identify surgical teaching behaviors that define teaching excellence.

Between 1995 and 1999 full-time surgeons in a division of general surgery were evaluated biannually by every resident on their services, using two 10-item Likert scales to assess frequency of performing selected teaching behaviors. Response categories ranged from 0 (does not demonstrate) to 4 (demonstrates the behavior to a very high degree). Mean scores > or =3.7 (1 SD above the mean) were categorized as evidence of superior teaching, whereas mean scores < or =2.4 (1 SD below the mean) were categorized as mediocre. Residents wrote statements identifying teaching strengths.

There were 753 individual resident assessments of 16 faculty. The overall mean rating for operating room and clinic teaching was 3.1, with 24% of the ratings > or =3.7 and 14% of the ratings < or =2.4. For operating room, discriminant behaviors were: demonstrates sensitivity to resident learning needs (3.85 versus 1.62, P <0.01) and provides direct feedback (3.60 versus 1.27, P <0.01). Residents' statements yielded themes tied to superior teaching: demonstrates technical expertise, allows resident participation, and maintains a learning climate of respect.

A resident-based teaching assessment system can offer a reasonable and valid form of feedback to academic surgeons. The use of mixed methods to identify teaching behaviors that characterize excellence informs faculty of how they are perceived as educators and provides examples of specific behaviors that merit commendation.