Enhancing Mixed Reality Simulation Training Technology With Real-Time Performance Visualization: Mixed Methods Study...

Area of Science:

• Medical Education Technology
• Human-Computer Interaction
• Emergency Medicine Training

Background:

• Mixed reality (MR) simulation offers a safe environment for training paramedics in high-stress scenarios like mass casualty incidents.
• Current MR training platforms lack real-time stress and human performance monitoring capabilities.

Purpose of the Study:

• To enhance MR training for medical first responders by incorporating real-time performance and stress level evaluation.
• To enable instructors to tailor feedback and optimize training challenge and safety using biosignal monitoring and analytics.

Main Methods:

• A multiphase approach including user requirement gathering, iterative prototype development, and a field trial with end-user consortium members.
• Quantitative analysis of feature usage and event occurrences, alongside qualitative thematic analysis of interviews and workshops.
• Development of an MR training system integrating real-time performance tracking and stress monitoring based on user feedback.

Main Results:

• Identified specific requirements for MR training systems, including 54 categorized performance metrics (e.g., scene safety, triage, communication).
• Highlighted the need for user-centered design and smart wearables for stress monitoring, with user preferences for dashboard and in-VR stress visualization.
• Field trial provided insights into practical application, trainer-trainee interaction, and areas for improvement in the developed MR training system.

Conclusions:

• The research successfully integrated real-time performance metrics and stress indicators into MR training for paramedics, guided by a human-centered design.
• This approach aligns with end-user needs, creating a foundation for more effective and immersive training solutions for high-stress professions.