Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Real-World Implementation of Large Language Models for Writing Clinical Discharge Summaries Within a Secure Data Environment: Development and Expert Evaluation Study.

JMIR AI·2026

Same author

Editorial: Synergizing large language models and computational intelligence for advanced robotic systems.

Frontiers in robotics and AI·2026

Same author

VeloRM: disentangling pre- and post-splicing RNA modification dynamics at single-cell resolution.

Nucleic acids research·2026

Same author

EndoLRMGS: Combining Large Reconstruction Modelling and Gaussian Splatting for Complete Endoscopic Scene Reconstruction.

IEEE transactions on medical imaging·2026

Same author

Variation in emergency department attendances and acute hospital admissions for ambulatory emergency care: a retrospective analysis of routinely collected NHS data across England.

BMJ open·2026

Same author

Improving the diagnostic performance of troponin assays for acute myocardial infarction in renal impairment.

Heart (British Cardiac Society)·2026

Same journal

Multimodal Cross-Attention Fusion of B-Mode Ultrasound and Strain Elastography for Tumor Segmentation in Robotics-Assisted Surgery.

IEEE transactions on medical robotics and bionics·2026

Same journal

A Pneumatically Actuated Robotic Assistant for MRI-Guided Stereotactic Neurosurgery.

IEEE transactions on medical robotics and bionics·2026

Same journal

Interdisciplinary Dialogues on Surgical Data Science: Revising Its Benefits for Surgical Stakeholders and Patients.

IEEE transactions on medical robotics and bionics·2026

Same journal

Concentric Tube Robot-Assisted Intracerebral Hemorrhage Evacuation: Validation in an Ovine Model.

IEEE transactions on medical robotics and bionics·2026

Same journal

Autonomous Slip-Prevention Grip Force Control and Its Potential in Shared Control of Robotic Prosthetic Hands.

IEEE transactions on medical robotics and bionics·2026

Same journal

Modeling and Control For Minimally Invasive Intracerebral Hemorrhage Evacuation.

IEEE transactions on medical robotics and bionics·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Aug 27, 2025

Three-dimensional Location Approach with Silk Thread Guided Laparoscopic Segmentectomy for Liver Tumor

Three-dimensional Location Approach with Silk Thread Guided Laparoscopic Segmentectomy for Liver Tumor

Published on: May 23, 2025

Simultaneous Depth Estimation and Surgical Tool Segmentation in Laparoscopic Images.

Baoru Huang^1,2, Anh Nguyen^1,3, Siyao Wang¹

¹The Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 2AZ, UK.

IEEE Transactions on Medical Robotics and Bionics

|September 23, 2022

Summary

This summary is machine-generated.

This study introduces a unified framework for robotic surgery, simultaneously performing surgical tool segmentation and depth estimation. This integrated approach enhances surgical autonomy and simplifies deployment by improving state-of-the-art performance for both tasks.

Keywords:

Deep learning Multi-task learning Self-supervised depth estimation Surgical instrument segmentation

More Related Videos

A Pipeline for 3D Multimodality Image Integration and Computer-assisted Planning in Epilepsy Surgery

A Pipeline for 3D Multimodality Image Integration and Computer-assisted Planning in Epilepsy Surgery

Published on: May 20, 2016

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Published on: April 5, 2024

Related Experiment Videos

Last Updated: Aug 27, 2025

Three-dimensional Location Approach with Silk Thread Guided Laparoscopic Segmentectomy for Liver Tumor

Three-dimensional Location Approach with Silk Thread Guided Laparoscopic Segmentectomy for Liver Tumor

Published on: May 23, 2025

A Pipeline for 3D Multimodality Image Integration and Computer-assisted Planning in Epilepsy Surgery

A Pipeline for 3D Multimodality Image Integration and Computer-assisted Planning in Epilepsy Surgery

Published on: May 20, 2016

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Published on: April 5, 2024

Area of Science:

Robotics
Computer Vision
Medical Imaging

Background:

Accurate surgical instrument segmentation and depth estimation are vital for advancing autonomy in robotic surgery.
Current methods often address these tasks independently, posing challenges for real-world deployment.

Purpose of the Study:

To develop a unified framework for simultaneous depth estimation and surgical tool segmentation in laparoscopic images.
To improve the efficiency and effectiveness of robotic surgery systems.

Main Methods:

An encoder-decoder network architecture with two branches was designed for parallel depth estimation and segmentation.
A novel multi-task loss function was proposed for unsupervised depth learning and semi-supervised segmentation.
Extensive experiments were conducted on diverse datasets to validate the framework.

Main Results:

The unified framework achieved state-of-the-art results for both surgical tool segmentation and depth estimation.
The end-to-end trained network demonstrated improved performance compared to separate task-specific models.
Deployment complexity was reduced by integrating both functionalities into a single network.

Conclusions:

The proposed unified framework effectively integrates depth estimation and surgical tool segmentation for enhanced robotic surgery.
This approach offers a more streamlined and efficient solution for improving surgical autonomy.
The findings pave the way for more advanced and autonomous robotic surgical systems.