Integrated eye tracking on Magic Leap One during augmented reality medical simulation: a technical report

Area of Science:

• Medical Simulation
• Augmented Reality Technology
• Human-Computer Interaction

Background:

• Augmented reality (AR) shows promise as a clinical teaching tool.
• Limited research exists on integrated eye-tracking within AR medical simulators.
• The Chariot Augmented Reality Medical (CHARM) simulator offers real-time communication in a portable format.

Purpose of the Study:

• To refine and validate the gaze-tracking capabilities of the CHARM simulator on the Magic Leap One (ML1) headset.
• To achieve a reliable eye-tracking capture rate for enhanced medical simulation training.

Main Methods:

• Recruited adult participants (18+) for the study.
• Utilized the ML1 headset to project a holographic patient scenario.
• Compared participant gaze targets from ML1 output against audio-recorded instructions.
• Iteratively modified eye-tracking software until an 80% capture rate was consistently met.

Main Results:

• Initial eye-tracking concordance was below 80% for the first 10 participants.
• The eye movement detection threshold was adjusted to reduce sensitivity and noise.
• The final three participants achieved gaze capture rates of 80%, 80%, and 80.1% after software modifications.

Conclusions:

• Eye-tracking technology can be reliably integrated and utilized with the ML1 headset when enabled by CHARM simulator software.
• The refined eye-tracking system demonstrates potential for accurate data collection in AR medical training.
• This advancement supports the development of more sophisticated and effective AR-based clinical education tools.