An augmented reality framework for soft tissue surgery.

Area of Science:

• Medical imaging
• Surgical technology
• Computer-assisted surgery

Background:

• Augmented reality (AR) in soft tissue laparoscopic surgery is gaining interest for intra-operative planning and image guidance.
• Current AR systems face challenges with tissue deformation, imaging limitations, and often require fiducials or manual alignment.
• Existing research typically addresses only parts of the registration pipeline, assuming static tissue conditions.

Purpose of the Study:

• To develop a novel augmented reality framework for intra-operative planning in soft tissue laparoscopic surgery.
• To enable accurate co-registration of pre-operative CT scans with intra-operative stereo laparoscopic images.
• To overcome limitations of existing methods by eliminating the need for fiducials and manual alignment, while compensating for tissue deformation.

Main Methods:

• A new AR framework co-registers pre-operative CT with stereo laparoscopic images.
• Cone beam CT and fluoroscopy are used as bridging modalities for registration.
• The system compensates for tissue deformation caused by insufflation and respiration, and allows laparoscope navigation.

Main Results:

• The proposed framework successfully co-registers pre-operative and intra-operative data.
• The system demonstrates robustness in compensating for tissue deformation.
• Validation was performed across diverse datasets including simulated, phantom, ex vivo, and in vivo data.

Conclusions:

• The novel AR framework offers a robust solution for intra-operative planning in soft tissue laparoscopic surgery.
• The approach addresses key challenges of tissue deformation and registration accuracy.
• This technology has the potential to enhance surgical precision and planning in minimally invasive procedures.