Related Experiment Video
Updated: Apr 11, 2026
Setup and Execution of the Rapid Cycle Deliberate Practice Death Notification Curriculum
Published on: August 5, 2020
An Observed Structured Teaching Evaluation Demonstrates the Impact of a Resident-as-Teacher Curriculum on Teaching
Matthew Zackoff1, Karen Jerardi2, Ndidi Unaka2
1Department of Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio Matthew.zackoff@cchmc.org.
Background And Objective:
Residents play a critical role in the education of peers and medical students, yet attainment of teaching skills is not routinely assessed. The primary aim of this study was to develop a novel, skill-based Observed Structured Teaching Evaluation (OSTE) and self-assessment survey to measure the impact of a resident-as-teacher curriculum on teaching competency. The secondary aim was to determine interrater reliability of the OSTE.
Methods:
A prospective study quantitatively assessed intern teaching competency via videotaped teaching encounters (videos) before and after a month-long hospital medicine rotation and self-assessment surveys over a 5-month period. The intervention group received the resident-as-teacher curriculum. Videos were evaluated by 2 blinded faculty via an OSTE covering 9 skills within 3 core components: preparation, teaching, and reflection. Pre- to post-HM rotation month differences were evaluated within and between groups using the Wilcoxon signed rank test and Wilcoxon rank-sum test, respectively.
Results:
Twenty-two of 25 (88%) control and 27 of 28 (96%) intervention interns participated; 100% of participants completed the study. The intervention group's pre-post difference for the total OSTE score and the average self-assessed competence statistically improved; however, no significant difference was seen between groups. The difference in preparation scores was significant for the intervention compared with the control. The OSTE's interrater reliability demonstrated good agreement with weighted kappas of 0.86 for preparation, 0.71 for teaching, and 0.93 for reflection.
Conclusions:
Implementation of an objective, skill-based OSTE detected observable changes in interns' teaching competency after implementation of a brief resident-as-teacher curriculum. The OSTE's good interrater reliability may allow standardized assessment of skill attainment over time.
Related Concept Videos
01:20Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
01:24Nursing Process for Patient and Caregiver Teaching I: Assessment and Diagnosis
It is critical to determine the patient's learning needs during the assessment. Determination of learning needs compounds data...
01:24Nursing Process for Patient and Caregiver Teaching II: Planning and Implementation
01:21Interdisciplinary Care: The Health Care Team-I
Physicians
The physician's primary responsibility is to diagnose illness and direct the medical or surgical treatment of the condition. The authority to admit patients to a healthcare agency or institution and practice care within that setting is granted to physicians by the healthcare agency or institution...
01:15Nursing Evaluation
01:15Nursing Implementation
The five steps to implementing effective nursing care include reassessing the patient, reviewing and revising the existing nursing care plan, organizing the resources and care delivery, anticipating and preventing complications, and implementing nursing interventions.