Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jul 21, 2025

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

771

MT-FiST: A Multi-Task Fine-Grained Spatial-Temporal Framework for Surgical Action Triplet Recognition.

Yuchong Li, Tong Xia, Huoling Luo

    IEEE Journal of Biomedical and Health Informatics
    |July 27, 2023
    PubMed
    Summary
    This summary is machine-generated.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Augmented Reality Navigation-Assisted Laparoscopic Hepatectomy: A Retrospective Comparison of Anatomical and Non-anatomical Resection.

    Clinical Medicine Insights. Oncology·2026
    Same author

    Correspondence-free local-to-global liver deformation correction via implicit neural representation and biomechanical model.

    International journal of computer assisted radiology and surgery·2026
    Same author

    A decoy virus strategy using plant-produced SARS-CoV-2 virus-like-particles to inhibit infection and lung injury.

    Journal of translational medicine·2026
    Same author

    Photocatalytic Synthesis of Aromatic Nitriles Using TiO<sub>2</sub> Nanotubes Decorated With Bismuth Halide Perovskite Nanodots.

    Angewandte Chemie (International ed. in English)·2026
    Same author

    Liver point cloud registration via multi-feature fusion and hyperbolic embedding for augmented reality surgical navigation.

    Computer methods and programs in biomedicine·2026
    Same author

    Optimal Dietary Patterns for Lower Weight Gain and Risk of Obesity Surrounding Menopause.

    JAMA network open·2026
    Same journal

    An Ultra-Lightweight Cross-scale Attention Mamba Network for Accurate Skin Lesion Segmentation.

    IEEE journal of biomedical and health informatics·2026
    Same journal

    Explanation-Guided Reconstruction of Missing Clinical Features for Survival Prediction in Pancreatic Cancer.

    IEEE journal of biomedical and health informatics·2026
    Same journal

    stDGCN: A dual-augmentation graph convolutional network for identifying spatial domains with attention mechanism.

    IEEE journal of biomedical and health informatics·2026
    Same journal

    Patient-specific Biomechanical Investigation of Percutaneous Pulmonary Valves: Towards the Integration of Routinely Acquired Clinical Data and Fluid-structure Interaction Simulations.

    IEEE journal of biomedical and health informatics·2026
    Same journal

    Cross-subject fMRI-to-Image with Visual-cortex 2D Representation and Pre-Training.

    IEEE journal of biomedical and health informatics·2026
    Same journal

    PGCASurv: A Prior-Guided Cross-Attention Framework for Dynamic Survival Model with Longitudinal Data.

    IEEE journal of biomedical and health informatics·2026
    See all related articles

    This study introduces MT-FiST, a novel framework for surgical action triplet recognition. It enhances computer-assisted surgery by improving fine-grained detail and temporal correlation in recognizing instruments, verbs, and targets.

    Area of Science:

    • Computer-assisted surgery
    • Medical image analysis
    • Surgical robotics

    Background:

    • Surgical action triplet recognition is crucial for computer-assisted surgery.
    • Current methods lack fine-grained subclass distinction and temporal correlation analysis.
    • Surgical triplets (instrument, verb, target) offer detailed scene information.

    Purpose of the Study:

    • To propose a multi-task fine-grained spatial-temporal framework (MT-FiST) for surgical action triplet recognition.
    • To address limitations in distinguishing fine-grained subclasses and capturing temporal dynamics.
    • To enhance decision-making in computer-assisted surgical environments.

    Main Methods:

    • Developed a multi-task fine-grained spatial-temporal framework (MT-FiST).

    More Related Videos

    Three-Dimensional Finger Motion Tracking during Needling: A Solution for the Kinematic Analysis of Acupuncture Manipulation
    08:27

    Three-Dimensional Finger Motion Tracking during Needling: A Solution for the Kinematic Analysis of Acupuncture Manipulation

    Published on: October 28, 2021

    2.9K
    Novel Triple-Loop Technique for Suturing TFCC Injuries without Transosseous Tunnel
    08:27

    Novel Triple-Loop Technique for Suturing TFCC Injuries without Transosseous Tunnel

    Published on: May 23, 2025

    142

    Related Experiment Videos

    Last Updated: Jul 21, 2025

    Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
    07:46

    Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

    Published on: August 9, 2024

    771
    Three-Dimensional Finger Motion Tracking during Needling: A Solution for the Kinematic Analysis of Acupuncture Manipulation
    08:27

    Three-Dimensional Finger Motion Tracking during Needling: A Solution for the Kinematic Analysis of Acupuncture Manipulation

    Published on: October 28, 2021

    2.9K
    Novel Triple-Loop Technique for Suturing TFCC Injuries without Transosseous Tunnel
    08:27

    Novel Triple-Loop Technique for Suturing TFCC Injuries without Transosseous Tunnel

    Published on: May 23, 2025

    142
  • Utilized a multi-label mutual channel loss with diversity and discriminative components.
  • Employed partial shared-parameters LSTM units for temporal correlation capture.

    • Main Results:

    • MT-FiST outperformed state-of-the-art models on the CholecT50 dataset.
    • Achieved significant improvements in mean Average Precision (mAP) for instrument, verb, target, and triplet recognition.
    • Demonstrated superior performance in fine-grained subclass recognition and temporal analysis.

    Conclusions:

    • The proposed MT-FiST framework effectively enhances surgical action triplet recognition.
    • MT-FiST improves context-aware surgical assistant systems through temporal aggregation and fine-grained feature learning.
    • This advancement contributes to more precise and informed computer-assisted surgeries.