Bio-inspired multimodal 3D endoscope for image-guided and robotic surgery

Area of Science:

• Biomedical Engineering
• Surgical Technology
• Optical Imaging

Background:

• Current endoscopic imaging limits surgeons' ability to visualize tumor margins in real-time.
• Simultaneous color and near-infrared (NIR) fluorescence imaging is not feasible under normal surgical illumination.
• This hinders effective cancer treatment and increases the risk of iatrogenic damage.

Purpose of the Study:

• To develop a novel multimodal 3D endoscope for enhanced image-guided and robotic surgery.
• To enable simultaneous, real-time imaging of 3D stereoscopic, color, and NIR fluorescence.
• To overcome limitations of current endoscopic systems without impeding surgical workflow.

Main Methods:

• A bio-inspired multimodal 3D endoscope was designed, integrating features of human eyes and mantis shrimp compound eyes.
• The endoscope comprises a binocular optical system, an optical relay system, and a multiband sensor.
• An optical relay system projects sub-images onto a single multiband sensor for simultaneous imaging.

Main Results:

• The developed endoscope successfully achieves simultaneous and real-time 3D stereoscopic, color, and NIR fluorescence imaging.
• Experimental results confirm its ability to provide real-time feedback on tumor and lymph node locations.
• The system offers an immersive surgical experience without disrupting the workflow.

Conclusions:

• The bio-inspired multimodal 3D endoscope significantly advances cancer treatment by improving tumor margin visualization.
• This technology enhances image-guided and robotic surgery by providing crucial real-time feedback.
• Its design offers excellent characteristics and scalability for future applications in surgical navigation.