Development and Evaluation of a Multimodal Debriefing Dashboard for Virtual Reality Cardiac Arrest Simulation

Area of Science:

• Medical Education
• Human-Computer Interaction
• Simulation Technology

Background:

• Virtual reality (VR) and wearable sensors offer novel insights into learning and performance in complex scenarios.
• Effective methods for conveying multimodal data (e.g., gaze, mental workload) from VR simulations are not well understood.
• A human-centered design approach was used to develop and evaluate a multimodal debriefing dashboard.

Purpose of the Study:

• To develop and evaluate an interactive multimodal debriefing dashboard for virtual reality simulations.
• To identify key features for conveying complex performance data to enhance learning.
• To assess the usability and effectiveness of the dashboard in improving simulation-based education.

Main Methods:

• A human-centered design process involving interviews and workshops with Advanced Cardiac Life Support (ACLS) instructors.
• Development of high-fidelity mock-ups and an interactive prototype based on user feedback.
• Evaluation of the prototype by a second group of ACLS instructors using pre-post assessments and surveys on usability, acceptability, and feasibility.

Main Results:

• The final dashboard integrates video, clinical action timelines, error identification, mental workload, and visual attention data.
• Participants using the dashboard provided targeted feedback on technical and non-technical skills aligned with learning objectives.
• The dashboard prototype achieved a high System Usability Scale score of 88.9%, indicating above-average usability.

Conclusions:

• An interactive multimodal debriefing dashboard was successfully developed using a user-design framework.
• Dashboard implementation led to improved evaluation and debriefing practices, enhancing learning outcomes.
• The dashboard shows potential to deepen understanding of skill acquisition in simulation-based learning through real-time analytics.