Real-time 3D visual tracking of laparoscopic instruments for robotized endoscope holder

Area of Science:

• Minimally Invasive Surgery
• Robotics
• Computer Vision

Background:

• Robotized endoscope holders improve surgeon control in laparoscopic procedures by reducing reliance on assistants.
• Seamless integration of robotic systems with surgical instruments is crucial for enhanced surgical workflows.

Purpose of the Study:

• To develop and validate a novel real-time 3D tracking method for laparoscopic instruments.
• To improve the convenience and intuitiveness of surgeon interaction with robotized endoscope holders.

Main Methods:

• The proposed method utilizes 3D position measurements of instrument insertion points and strip markers.
• Depth estimation of the instruments is combined with positional data for accurate tracking.
• The technique is designed for real-time performance in simulated surgical environments.

Main Results:

• Experimental results demonstrate the method's speed and robustness in simulated laparoscopic settings.
• The tracking system accurately determines the 3D positions of surgical instruments.

Conclusions:

• The developed 3D tracking method offers a fast and robust solution for real-time instrument localization.
• This technology has the potential to significantly enhance surgeon-robot interactions in robotic-assisted laparoscopic surgery.