Augmented Reality Guided Laparoscopic Surgery of the Uterus

Area of Science:

• Computer-assisted intervention (CAI)
• Surgical robotics
• Medical imaging and visualization

Background:

• Augmented Reality (AR) guidance is crucial for Computer Assisted Intervention (CAI) in laparoscopic surgery.
• Real-time registration and fusion of pre-operative data (MR/CT) with laparoscopic video are essential for visualizing critical structures.
• Existing systems often require additional hardware like optical trackers, limiting their applicability.

Purpose of the Study:

• To present the first system for AR-guided laparoscopic surgery of the uterus.
• To address the challenges of registering and tracking a mobile, weakly-textured organ like the uterus.
• To achieve markerless, real-time registration and AR guidance using monocular laparoscopes without interventional hardware.

Main Methods:

• Utilized pre-operative Magnetic Resonance (MR) or Computed Tomography (CT) data.
• Developed novel solutions for initial registration using an exploratory video.
• Implemented real-time update registration via tracking-by-detection algorithms.
• Employed monocular laparoscopes without additional optical trackers.

Main Results:

• Successfully performed markerless, real-time registration and AR visualization of the uterus during laparoscopic surgery.
• Demonstrated robust tracking of a highly mobile, weakly-textured organ.
• The system operated effectively in an operating room (OR) setting.

Conclusions:

• This work represents a significant advancement in AR-guided surgery for mobile organs.
• The developed system provides a practical solution for real-time surgical guidance without specialized hardware.
• It paves the way for enhanced precision and safety in laparoscopic uterine surgeries.