Comparison of 2D and autostereoscopic 3D visualization during mixed reality simulation

Area of Science:

• Medical Simulation
• Surgical Visualization
• Human-Computer Interaction

Background:

• Minimally invasive surgery often relies on 2D visualization, hindering depth perception and increasing surgeon cognitive load.
• This limitation contributes to a steep learning curve for surgical procedures.

Purpose of the Study:

• To investigate the benefits of autostereoscopic (3D) displays in restoring depth perception during simulated laparoscopic tasks.
• To compare surgical performance using 2D versus 3D visualization in a mixed reality environment.

Main Methods:

• Development of a mixed reality simulator integrating physical instruments with virtual environments (SOFA).
• Use of electromagnetic sensors to track instrument pose and finite element modeling for soft tissue deformation simulation.
• Comparison of participant performance on a virtual laparoscopic task using both 2D and autostereoscopic 3D visualization.

Main Results:

• Participants using 3D visualization showed significant improvements: 16% faster task completion, 25% less traveled distance, and 14% fewer errors.
• No significant difference in average contact forces was observed between 2D and 3D conditions.
• Statistical significance was found for improvements in time and distance traveled with 3D vision.

Conclusions:

• Autostereoscopic 3D visualization offers superior performance compared to conventional 2D displays in simulated laparoscopic surgery.
• The enhanced depth perception in 3D reduces unnecessary instrument movements between targets.
• Future research should explore the integration of haptic feedback alongside visual feedback in 3D surgical simulations.