Related Experiment Video
Updated: Jun 28, 2025

Intraoperative Gastroscopy for Tumor Localization in Laparoscopic Surgery for Gastric Adenocarcinoma
Published on: August 9, 2016
Towards navigation in endoscopic kidney surgery based on preoperative imaging
Ayberk Acar1,2, Daiwei Lu1, Yifan Wu1
1Department of Computer Science Vanderbilt University Nashville Tennessee USA.
Abstract:
Endoscopic renal surgeries have high re-operation rates, particularly for lower volume surgeons. Due to the limited field and depth of view of current endoscopes, mentally mapping preoperative computed tomography (CT) images of patient anatomy to the surgical field is challenging. The inability to completely navigate the intrarenal collecting system leads to missed kidney stones and tumors, subsequently raising recurrence rates. A guidance system is proposed to estimate the endoscope positions within the CT to reduce re-operation rates. A Structure from Motion algorithm is used to reconstruct the kidney collecting system from the endoscope videos. In addition, the kidney collecting system is segmented from CT scans using 3D U-Net to create a 3D model. The two collecting system representations can then be registered to provide information on the relative endoscope position. Correct reconstruction and localization of intrarenal anatomy and endoscope position is demonstrated. Furthermore, a 3D map is created supported by the RGB endoscope images to reduce the burden of mental mapping during surgery. The proposed reconstruction pipeline has been validated for guidance. It can reduce the mental burden for surgeons and is a step towards the long-term goal of reducing re-operation rates in kidney stone surgery.
Insights
This study introduces a novel guidance system for endoscopic kidney surgery. By reconstructing the kidney
Area of Science:
- Medical Imaging
- Surgical Technology
- Urology
Background:
- Endoscopic renal surgeries face high re-operation rates due to limited visualization.
- Surgeons struggle to mentally map preoperative CT scans to the endoscopic view, leading to missed anatomy.
- Incomplete navigation of the intrarenal collecting system contributes to missed stones and tumors, increasing recurrence.
Purpose of the Study:
- To develop and validate a guidance system for estimating endoscope position within CT scans during renal surgery.
- To reduce re-operation rates by improving intraoperative navigation and reducing the cognitive burden on surgeons.
- To create a 3D map integrating endoscopic video with preoperative imaging for enhanced surgical guidance.
Main Methods:
- Utilized Structure from Motion (SfM) to reconstruct the kidney's collecting system from endoscopic videos.
- Employed 3D U-Net for segmenting the intrarenal collecting system from CT scans to generate a 3D model.
- Registered the SfM-derived and CT-derived collecting system models to determine relative endoscope position.
Main Results:
- Successfully reconstructed intrarenal anatomy and accurately localized the endoscope's position.
- Demonstrated the creation of a 3D map integrating RGB endoscopic images with the reconstructed anatomy.
- Validated the reconstruction pipeline for surgical guidance, showing potential to reduce mental mapping burden.
Conclusions:
- The proposed guidance system aids in reconstructing and localizing intrarenal anatomy during endoscopic surgery.
- This technology can decrease the cognitive load on surgeons, facilitating better navigation.
- It represents a significant advancement towards reducing re-operation rates in kidney stone surgery.
Related Concept Videos
Endoscopic Procedures V: ERCP
Patient...
Endoscopic Procedures II: Colonoscopy
Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...

