LARLUS: laparoscopic augmented reality from laparoscopic ultrasound

Area of Science:

• Medical Imaging
• Surgical Technology
• Computer-Assisted Surgery

Background:

• Minimally invasive surgery faces challenges in tumor localization due to lack of tactile feedback and limited visibility.
• Conventional laparoscopic ultrasound (LUS) has a steep learning curve and is operator-dependent, hindering its widespread adoption.

Purpose of the Study:

• To improve tumor localization in minimally invasive surgeries.
• To enhance surgeons' understanding of tumor and organ anatomy through image augmentation.
• To develop a more intuitive and effective surgical guidance system.

Main Methods:

• Augmenting laparoscopic ultrasound (LUS) images onto laparoscopic video feeds.
• Utilizing LUS pose estimation for accurate image registration.
• Implementing filtering techniques to stabilize augmented images and reduce flickering.

Main Results:

• Successful registration and augmentation of LUS images onto laparoscopic images using clinical data.
• Demonstrated reduction in augmentation flickering through advanced filtering.
• Validation of the approach's efficacy in improving anatomical visualization.

Conclusions:

• LUS image augmentation shows significant potential to aid surgeons in tumor localization during minimally invasive procedures.
• The developed technique can serve as a valuable training tool for surgical residents and fellows.
• Further research is needed to refine methods for disambiguating rotational symmetry and enhance user convenience.