Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Real-World Insights in Designing SteatoStat: An End-to-End Deep Learning Pipeline for Hepatic Steatosis Quantification.

Diagnostics (Basel, Switzerland)·2026
Same author

Annotation-efficient medical image segmentation via cross-latent graphs and vector-quantized memory.

Medical image analysis·2026
Same author

STAGE challenge: Structural-Functional Transition in Glaucoma Assessment.

Medical image analysis·2026
Same author

Angiography-free diagnosis of retinal diseases via interpretable multi-modal learning.

NPJ digital medicine·2026
Same author

Multi-Granularity Topological Reasoning for Anatomically Consistent Vasculature Parsing.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same author

M2Net: Multimodal Multitask Mutual Learning for Anti-VEGF Efficacy Prediction.

IEEE transactions on medical imaging·2026
Same journal

MUST: Multi-style virtual staining with incomplete pairs.

IEEE transactions on medical imaging·2026
Same journal

BrainCL: Transformer-Based Brain Network Contrastive Learning with Multi-Order Topology and Salience Masking.

IEEE transactions on medical imaging·2026
Same journal

LLM-enhanced Neuron Segmentation and Reconstruction in Complex Mouse Brain Images.

IEEE transactions on medical imaging·2026
Same journal

Matrixed-Spectrum Decomposition Accelerated Linear Boltzmann Transport Equation Solver for Fast Scatter Correction in Multi-Spectral CT.

IEEE transactions on medical imaging·2026
Same journal

The Ritz Adjoint Method for MRI Pulse Design.

IEEE transactions on medical imaging·2026
Same journal

Physiology-guided Self-supervised Learning for Simultaneous Dual-Tracer PET Separation.

IEEE transactions on medical imaging·2026
See all related articles

Related Experiment Video

Updated: Jun 29, 2025

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

718

Instrument-Tissue Interaction Detection Framework for Surgical Video Understanding.

Wenjun Lin, Yan Hu, Huazhu Fu

    IEEE Transactions on Medical Imaging
    |March 26, 2024
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces a new method for detecting instrument-tissue interactions in surgical videos, improving computer-assisted surgery systems. The developed Instrument-Tissue Interaction Detection Network (ITIDNet) accurately identifies instruments, tissues, and actions for better surgical understanding.

    More Related Videos

    Multimodal Imaging and Spectroscopy Fiber-bundle Microendoscopy Platform for Non-invasive, In Vivo Tissue Analysis
    10:35

    Multimodal Imaging and Spectroscopy Fiber-bundle Microendoscopy Platform for Non-invasive, In Vivo Tissue Analysis

    Published on: October 17, 2016

    7.9K
    Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery
    05:12

    Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

    Published on: August 12, 2021

    2.0K

    Related Experiment Videos

    Last Updated: Jun 29, 2025

    Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
    07:46

    Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

    Published on: August 9, 2024

    718
    Multimodal Imaging and Spectroscopy Fiber-bundle Microendoscopy Platform for Non-invasive, In Vivo Tissue Analysis
    10:35

    Multimodal Imaging and Spectroscopy Fiber-bundle Microendoscopy Platform for Non-invasive, In Vivo Tissue Analysis

    Published on: October 17, 2016

    7.9K
    Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery
    05:12

    Robotized Testing of Camera Positions to Determine Ideal Configuration for Stereo 3D Visualization of Open-Heart Surgery

    Published on: August 12, 2021

    2.0K

    Area of Science:

    • Computer Vision
    • Medical Imaging
    • Surgical Robotics

    Background:

    • Instrument-tissue interaction detection is crucial for computer-assisted surgery systems.
    • Existing methods lack fine-grained detection of instruments and tissues and do not fully model inter-frame relationships.
    • Accurate surgical activity understanding requires detailed interaction analysis.

    Purpose of the Study:

    • To propose a novel approach for detailed instrument-tissue interaction detection in surgical videos.
    • To develop an Instrument-Tissue Interaction Detection Network (ITIDNet) capable of detecting instrument-tissue interactions as structured quintuples.
    • To enhance the understanding of surgical activities through improved video analysis.

    Main Methods:

    • Representing instrument-tissue interaction as a quintuple: 〈instrument class, instrument bounding box, tissue class, tissue bounding box, action class〉.
    • Introducing a Snippet Consecutive Feature (SCF) Layer to model relationships within video snippets.
    • Proposing a Spatial Corresponding Attention (SCA) Layer for inter-frame feature incorporation.
    • Utilizing a Temporal Graph (TG) Layer for reasoning intra- and inter-frame instrument-tissue relationships.

    Main Results:

    • The proposed ITIDNet demonstrated superior performance in detecting instrument-tissue interactions.
    • The model outperformed existing state-of-the-art methods on newly created cataract (PhacoQ) and cholecystectomy (CholecQ) surgery video datasets.
    • The SCF, SCA, and TG layers effectively enhanced feature representation and relationship modeling.

    Conclusions:

    • The developed ITIDNet provides a robust framework for detailed instrument-tissue interaction detection in surgical videos.
    • The proposed method significantly advances the field of surgical video understanding and computer-assisted surgery.
    • The novel dataset and model offer a valuable resource for future research in surgical activity recognition.