A Mixed-Methods Realist Analysis of an Interdisciplinary Simulation Intervention for Psychiatry Residents

Simulation research in postgraduate psychiatry remains limited, with minimal studies on interdisciplinary involvement and mechanisms of change. To address these gaps, the authors implemented a mixed-methods realist analysis of an interdisciplinary simulation intervention administered to psychiatry residents.

The University of Calgary implemented a simulation intervention for psychiatry residents. Eight junior residents participated in or observed 4 scenarios and eighteen senior residents participated in or observed 8 scenarios. Scenarios lasted 15 minutes with a pre-simulation orientation and post-scenario debrief. Most scenarios involved interdisciplinary staff. Scenarios included agitated and suicidal patients; treatment-related emergencies; and challenging conversations. All residents completed pre- and post-simulation surveys reporting confidence levels. Changes in confidence were analyzed using paired t tests and differences between junior and senior residents' confidence using ANOVA. Eleven residents participated in 2 focus groups. Transcripts were analyzed using a constant comparative model to identify contexts, mechanisms, outcomes, and the relationship between these realist categories. Key themes were extracted using generic theme analysis.

Aggregated survey data demonstrated statistically significant improvements in self-reported confidence for 7 of 8 proposed scenarios, with variations in confidence outcomes between junior and senior residents. Four themes emerged: (1) How Simulations Facilitate Learning, (2) The Role of Pre-simulation Instructions, (3) Factors Facilitating Confidence, (4) Positive Effects of Interdisciplinary Involvement.

This study identifies possible mechanisms for residents' self-reported improvements in learning and confidence, which may help programs tailor interventions. Furthermore, this study suggests there may be benefits to interdisciplinary simulations, with self-reported outcomes of improved collaboration and safety planning.