Autostereoscopic 3D Augmented Reality Navigation for Laparoscopic Surgery: A Preliminary Assessment

Area of Science:

• Medical Technology
• Surgical Navigation
• Augmented Reality

Background:

• Augmented Reality (AR) and 3D visualization significantly impact surgical safety and outcomes.
• Laparoscopic surgery benefits from advanced visualization techniques for improved precision.

Purpose of the Study:

• To investigate the potential of autostereoscopic 3D AR (glasses-free) for surgical navigation in laparoscopic surgery.
• To evaluate the effectiveness of 3D AR compared to 2D AR in terms of depth perception and user experience.

Main Methods:

• Developed a deformable autostereoscopic 3D AR navigation framework using CPD-based deformation registration and virtual view generation algorithms.
• Evaluated depth perception and user experience using an in-vitro porcine heart model and offline clinical laparoscopic images, comparing 3D AR to 2D AR.

Main Results:

• Autostereoscopic 3D AR provided more consistent spatial perception and shorter measuring times (p < 0.05) than 2D AR.
• Improved relative depth perception for objects with smaller separations (<= 3.28 mm).
• User experience with 3D AR was perceived as worse than with 2D AR.

Conclusions:

• Autostereoscopic 3D AR offers a more efficient and robust sense of spatial scale, potentially shortening operating times and improving surgical outcomes.
• Image blur and distortion require solutions to enhance perception.
• High precision registration and visualization fluency are critical challenges for soft tissue navigation using autostereoscopic 3D AR.