Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Autonomous RCM-less endoscope control: integrating force-based pivoting with deep learning visual servoing.

Scientific reports·2026
Same author

Improved early prediction of acute pancreatitis severity using SHAP-based XGBoost model: Beyond traditional scoring systems.

Digestive and liver disease : official journal of the Italian Society of Gastroenterology and the Italian Association for the Study of the Liver·2025
Same author

Tackling Post-COVID-19 Rehabilitation Challenges: A Pilot Clinical Trial Investigating the Role of Robotic-Assisted Hand Rehabilitation.

Journal of clinical medicine·2024
Same author

Interaction with a Hand Rehabilitation Exoskeleton in EMG-Driven Bilateral Therapy: Influence of Visual Biofeedback on the Users' Performance.

Sensors (Basel, Switzerland)·2023
Same author

Assessment of the Patient's Emotional Response with the RobHand Rehabilitation Platform: A Case Series Study.

Journal of clinical medicine·2022
Same author

Gauze Detection and Segmentation in Minimally Invasive Surgery Video Using Convolutional Neural Networks.

Sensors (Basel, Switzerland)·2022
Same journal

RETRACTED: Zhang et al. A Novel Framework for Reconstruction and Imaging of Target Scattering Centers via Wide-Angle Incidence in Radar Networks. <i>Sensors</i> 2025, <i>25</i>, 6802.

Sensors (Basel, Switzerland)·2026
Same journal

Enhancing Unsupervised Multi-Source Domain Adaptation for Person Re-Identification via Mixture of Experts and Graph-Based Relation.

Sensors (Basel, Switzerland)·2026
Same journal

Development of an Instrumented Glove for Palmar Pressure Assessment in Kayakers.

Sensors (Basel, Switzerland)·2026
Same journal

Development and Experimental Validation of an Autonomous IoT-Based Monitoring System for Real-Time Water Quality Assessment in the Amazon River.

Sensors (Basel, Switzerland)·2026
Same journal

Semi-Supervised Adversarial Learning Framework for Controller Area Network Bus Intrusion Detection.

Sensors (Basel, Switzerland)·2026
Same journal

Smart Optimization Method for Safety Signs in Innovative Manufacturing Environments Integrating Industrial Field IoT Sensors and Knowledge Graphs.

Sensors (Basel, Switzerland)·2026
See all related articles

Related Experiment Video

Updated: Jun 21, 2025

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

698

Real-Time Tool Localization for Laparoscopic Surgery Using Convolutional Neural Network.

Diego Benavides1, Ana Cisnal1, Carlos Fontúrbel1

  • 1Instituto de las Tecnologías Avanzadas de la Producción (ITAP), Escuela de Ingenierías Industriales, Universidad de Valladolid, Paseo Prado de la Magdalena 3-5, 47011 Valladolid, Spain.

Sensors (Basel, Switzerland)
|July 13, 2024
PubMed
Summary
This summary is machine-generated.

This study introduces a convolutional neural network model for real-time surgical tool localization in laparoscopy. The Hourglass-based model enhances surgical robotics by accurately identifying tools, improving efficiency.

Keywords:
artificial intelligencebiomedical image processingconvolutional neural networklaparoscopy robotic surgeryreal-timesurgical tool tracking

More Related Videos

Author Spotlight: Integrating Ultrasound Imaging with Biochemical Markers for Thyroid Disease Diagnosis
05:41

Author Spotlight: Integrating Ultrasound Imaging with Biochemical Markers for Thyroid Disease Diagnosis

Published on: February 9, 2024

582
Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery
05:12

Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

Published on: August 12, 2021

2.0K

Related Experiment Videos

Last Updated: Jun 21, 2025

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

698
Author Spotlight: Integrating Ultrasound Imaging with Biochemical Markers for Thyroid Disease Diagnosis
05:41

Author Spotlight: Integrating Ultrasound Imaging with Biochemical Markers for Thyroid Disease Diagnosis

Published on: February 9, 2024

582
Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery
05:12

Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

Published on: August 12, 2021

2.0K

Area of Science:

  • Medical Robotics
  • Computer Vision
  • Surgical Technology

Background:

  • Partially automated robotic systems are crucial for improving surgical precision and efficiency.
  • Laparoscopic surgery requires precise instrument control, often demanding significant manual dexterity.

Purpose of the Study:

  • To develop a real-time tool localization method for laparoscopic surgery using convolutional neural networks.
  • To enable simultaneous localization of up to two surgical tools.

Main Methods:

  • A convolutional neural network model featuring two sequential Hourglass modules was designed.
  • The model was trained and evaluated on three datasets: ITAP, Atlas Dione, and EndoVis Challenge.
  • Grad-CAM technique was employed for model interpretability.

Main Results:

  • The best Hourglass-based model achieved 92.86% accuracy and 27.64 FPS, suitable for robotic integration.
  • An independent test set evaluation showed slightly reduced accuracy, suggesting limited generalizability.
  • The model demonstrated functional insights via Grad-CAM analysis.

Conclusions:

  • The proposed model offers a promising approach for automating laparoscopic surgery tasks.
  • Real-time tool localization can enhance surgical efficiency by reducing manual endoscope manipulation.
  • Further development is needed to improve generalizability for broader clinical application.