Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

GeoPep: A Geometry-Aware Masked Language Model for Protein-Peptide Binding Site Prediction.

Journal of chemical information and modeling·2026
Same author

20(S/R)-Ginsenoside Rh1 Alleviates AOM/DSS-Induced Colorectal Cancer: Gut-Microbiota Modulation and Tryptophan-Metabolism-Mediated AhR/PXR Activation and IDO1.

International journal of molecular sciences·2026
Same author

Author Correction: [2+2] Photocycloaddition reactions of sulfinylamines with alkenes to access β-sultam derivatives.

Nature chemistry·2026
Same author

A latent profile analysis of exercise intensity preference and tolerance: associations with exercise affective experiences and physical activity.

BMC psychology·2026
Same author

The in vivo inhibitory function of the MHC-I α3 domain-CD8α interaction.

bioRxiv : the preprint server for biology·2026
Same author

Novel <i>N</i>'-Phenyl Benzyl Carbazate Derivatives with Potent Multiple Antifungal Activity: Design, Structure-Activity Relationship, and Action Mode.

Journal of agricultural and food chemistry·2026

Related Experiment Video

Updated: Dec 28, 2025

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

1.1K

Real-time surgical instrument detection in robot-assisted surgery using a convolutional neural network cascade.

Zijian Zhao1, Tongbiao Cai1, Faliang Chang1

  • 1School of Control Science and Engineering, Jinan, Shandong, People's Republic of China.

Healthcare Technology Letters
|February 11, 2020
PubMed
Summary

This study introduces a new real-time surgical instrument detection system for robot-assisted surgery. The method uses a cascading convolutional neural network (CNN) for faster and more accurate multi-tool identification.

Keywords:
ATLAS Dione datasetCNNEndoVis Challenge datasetRGB image framesauthorsbounding-box regressioncascading convolutional neural networkconvolutional neural netsconvolutional neural network cascadedeep learning methodsdetection heatmapsframe-by-frame detection methodhourglass networkimage colour analysislearning (artificial intelligence)mainstream detection methodsmedical image processingmedical roboticsmodified VGG networkobject detectionreal-time multi-tool detectionreal-time multitool detectionreal-time surgical instrument detectionregression analysisrobot visionrobot-assisted surgery videossingle-tool detectionsurgerytool tip areasvision component

More Related Videos

Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
10:25

Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation

Published on: September 2, 2025

420
A Spine Robotic-Assisted Navigation System for Pedicle Screw Placement
06:24

A Spine Robotic-Assisted Navigation System for Pedicle Screw Placement

Published on: May 11, 2020

9.2K

Related Experiment Videos

Last Updated: Dec 28, 2025

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

1.1K
Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
10:25

Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation

Published on: September 2, 2025

420
A Spine Robotic-Assisted Navigation System for Pedicle Screw Placement
06:24

A Spine Robotic-Assisted Navigation System for Pedicle Screw Placement

Published on: May 11, 2020

9.2K

Area of Science:

  • Computer Vision
  • Robotics
  • Medical Imaging

Background:

  • Surgical instrument detection is crucial for robot-assisted surgery systems.
  • Current deep learning methods often struggle with low detection speed and single-tool focus.

Purpose of the Study:

  • To develop a real-time, accurate multi-tool detection method for robot-assisted surgery videos.
  • To overcome the speed limitations of existing single-tool detection approaches.

Main Methods:

  • A novel frame-by-frame detection approach using a cascading convolutional neural network (CNN).
  • Integration of an hourglass network for heatmap generation and a modified VGG network for bounding-box regression.
  • Joint prediction of tool tip localization using heatmaps and RGB image frames.

Main Results:

  • The proposed method demonstrates superior performance compared to mainstream detection techniques.
  • Achieved higher accuracy and speed in surgical instrument detection.
  • Validated on the EndoVis Challenge and ATLAS Dione datasets.

Conclusions:

  • The cascading CNN approach offers an effective solution for real-time multi-tool detection in robot-assisted surgery.
  • The method significantly improves both the accuracy and speed of surgical instrument identification.
  • This advancement has the potential to enhance the capabilities of robotic surgical systems.