Related Experiment Video
Updated: Jan 31, 2026
Setting Up a Stroke Team Algorithm and Conducting Simulation-based Training in the Emergency Department - A Practical Guide
Published on: January 15, 2017
Generative AI in simulation debriefings: an exploratory study using the Team-FIRST framework and qualitative feedback
David W Tscholl1, Max Ebensperger2, Arend RahrischRahrisch1
1Institute for Anesthesiology and Perioperative Medicine, University Hospital Zurich, University of Zurich, Zurich, Switzerland.
Background:
Effective debriefings in simulation-based education require accurate observation of team interactions, yet facilitators face challenges due to cognitive load, observer bias, and the complexity of team dynamics. Generative artificial intelligence (AI) tools offer a potential means to support this process by analyzing verbal communication and providing structured feedback. This study explored how AI tools can contribute to teamwork observation and debriefing in immersive medical simulations.
Methods:
We conducted a qualitative, exploratory study using thematic analysis of simulation participants' and debriefers' experiences with AI-generated teamwork reports. Forty-one participants (anesthesia nurses, residents, and attendings) participated in immersive scenarios at the University Hospital Zurich simulation center. Verbal interactions were transcribed with AI-assisted speech recognition and analyzed using two large language model-based systems (Isaac and ChatGPT-4o) guided by a prompt based on the Team-FIRST framework. Structured reports were generated for each scenario and reviewed by four simulation experts. Semi-structured interviews captured learners' perspectives on being observed by AI tools.
Results:
A total of 26 AI-generated reports and 27 learner interviews were analyzed. Experts valued the detailed transcripts and illustrative quotes, which supported structured feedback and captured observations that might otherwise be missed. Limitations included inaccuracies in categorization, misattribution of speakers, overly generalized interpretations, and the absence of contextual or nonverbal information. Learners expressed openness and optimism about AI's potential benefits: efficiency, objectivity, and enhanced perception, while also raising concerns about transparency, data protection, interpretation errors, and risks of overreliance. Both groups emphasized the necessity of human oversight.
Conclusion:
Generative AI tools can complement simulation debriefings by structuring communication data and highlighting teamwork patterns, supporting reflective practice. Current limitations highlight the need for multimodal approaches, refined prompting strategies, and integration with expert facilitation to ensure AI functions as a support tool rather than a replacement in simulation-based education.
Trial Registration:
BASEC ID: Req-2024-01642.
Related Concept Videos
00:46Feedback Inhibition
03:46Qualitative Analysis
For instance, group IV...
01:10Qualitative Analysis
There are two main approaches to qualitative analysis:...
01:01Feedback Loops
01:24Effects of feedback
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
01:26Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...