Moving-Tolerant Augmented Reality Surgical Navigation System Using Autostereoscopic Three-Dimensional Image Overlay

Area of Science:

• Medical Imaging
• Computer-Aided Surgery
• Augmented Reality

Background:

• Conventional augmented reality (AR) surgical navigation systems utilize image overlay for minimally invasive surgery.
• Existing systems face limitations including restricted viewing zones, inadequate 3D image guidance, and restricted mobility.
• Current systems require direct line-of-sight optical tracking, limiting device movement and placement.

Purpose of the Study:

• To develop a moving-tolerant AR surgical navigation system for improved intraoperative guidance.
• To eliminate the need for direct line-of-sight optical tracking during surgery.
• To enhance the feasibility and reliability of 3D overlay AR surgical navigation.

Main Methods:

• Proposed a moving-tolerant AR surgical navigation system employing autostereoscopic image overlay.
• System captures binocular image sequences of environmental changes to locate the overlay device, bypassing direct tracking.
• Validated the system through computer simulations and a computer-generated integral photography-based 3D overlay AR system.

Main Results:

• Computer simulations confirmed the reliability of the proposed moving-tolerant AR system.
• Experimental validation demonstrated the system's ability to consistently fuse 3D images with the patient.
• The system successfully overcame the limitations of restricted viewing zones and free movement.

Conclusions:

• The developed moving-tolerant AR surgical navigation system enhances the feasibility and reliability of 3D overlay AR surgical navigation.
• This approach removes the constraints of optical tracking, allowing for greater surgical flexibility.
• The system provides intuitive 3D image guidance without compromising the ability to track the overlay device.