Related Experiment Video
Updated: May 18, 2026
10:25
Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
Endoscopic vision-based tracking of multiple surgical instruments during robot-assisted surgery
Jiwon Ryu1, Jaesoon Choi, Hee Chan Kim
1Interdisciplinary Program, Bioengineering Major, Graduate School, Medical Research Center, Seoul National University, Seoul, Korea.
Artificial Organs
|October 10, 2012
Summary
This study introduces a vision-based system for automatically tracking surgical instruments during robot-assisted surgery. The technology enhances safety by detecting potential collisions and preventing harmful events, improving surgical outcomes.
Area of Science:
- Robotics
- Computer Vision
- Surgical Technology
Background:
- Robot-assisted minimally invasive surgery offers benefits in confined surgical spaces.
- Current systems lack robust safety features to prevent inadvertent harm from instrument interactions.
- Automatic tracking of surgical instruments is crucial for enhancing safety and preventing complications.
Purpose of the Study:
- To develop and validate a vision-based instrument tracking scheme for robot-assisted surgery.
- To enhance surgical safety by preventing tissue perforation and instrument collisions.
- To augment current robotic surgical systems with real-time safety monitoring.
Main Methods:
- A computer vision algorithm combining k-means clustering for metallic property classification and similarity measures for instrument tracking.
- Utilized Euclidean distance calculations and a Kalman filter for precise movement tracking.
- Validated the system using actual robot-assisted surgery videos and comparing detected trajectories with ground truth data.
Main Results:
- The implemented system demonstrated satisfactory performance in tracking instruments and detecting collisions.
- Quantitative validation showed accurate trajectory comparisons between automatic detection and manual ground truth.
- The developed methods effectively tracked instruments and their potential collisions within surgical videos.
Conclusions:
- The proposed vision-based instrument tracking system significantly enhances safety in robot-assisted surgery.
- The collision warning system provides valuable real-time information to clinicians.
- This technology represents a meaningful advancement for safer robotic surgical procedures.
