Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Transformers with Joint Tokens and Local-Global Attention for Efficient Human Pose Estimation.

IEEE transactions on pattern analysis and machine intelligence·2026

Same author

Ultrafast Ultraviolet Optoelectronic Logic Gate Devices with Ultralow Energy Consumption.

Nano letters·2026

Same author

Predicting lateral cervical lymph node involvement in papillary thyroid carcinoma patients: development of a nomogram model based on contrast-enhanced ultrasound images.

Gland surgery·2026

Same author

The stability landscape of mRNA vaccines: challenges and mitigation strategies.

Vaccine·2026

Same author

Radiotherapy Strategies for Stage II Breast Cancer With Lymphovascular Invasion After Mastectomy.

Anticancer research·2026

Same author

[Brain-controlled unmanned aerial vehicle system based on meta brain computer interface open-source software platform].

Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi·2025

Same journal

LiftReg: Limited Angle 2D/3D Deformable Registration.

Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention·2026

Same journal

Inverse Consistency by Construction for Multistep Deep Registration.

Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention·2026

Same journal

Can Crowdsourced Annotations Improve AI-based Congestion Scoring For Bedside Lung Ultrasound?

Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention·2026

Same journal

Equivariant Filters for Efficient Tracking in 3D Imaging.

Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention·2026

Same journal

Lobar Lung Density Embeddings with a Transformer encoder (LobTe) to predict emphysema progression in COPD.

Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention·2026

Same journal

uniGradICON: A Foundation Model for Medical Image Registration.

Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention·2026

See all related articles

Search research articles

Related Experiment Video

Updated: May 3, 2026

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

Surgical gesture segmentation and recognition.

Lingling Tao¹, Luca Zappella¹, Gregory D Hager¹

¹Johns Hopkins University, 3400 North Charles Street, Baltimore, MD 21218, USA.

Medical Image Computing and Computer-Assisted Intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

|February 8, 2014

Summary

This summary is machine-generated.

This study introduces a new framework for robotic surgery training, jointly segmenting and recognizing surgical gestures from both kinematic and video data. The combined approach significantly enhances performance compared to using either data source alone.

More Related Videos

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Published on: March 28, 2025

Related Experiment Videos

Last Updated: May 3, 2026

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Published on: March 28, 2025

Area of Science:

Robotics
Computer Vision
Surgical Training

Background:

Automatic surgical gesture segmentation and recognition are crucial for effective robotic surgery training.
Existing methods primarily utilize robot kinematic data, with recent work exploring video data but assuming known segmentation.
A gap exists in jointly segmenting and recognizing gestures using both kinematic and video data.

Purpose of the Study:

To propose a novel framework for the joint segmentation and recognition of surgical gestures.
To leverage both kinematic and video data for improved performance in robotic surgery.
To develop a model that outperforms existing methods using single data sources.

Main Methods:

Developed a combined Markov/semi-Markov conditional random field (MsM-CRF) model.
Exploited both frame-level kinematic cues and segment-level video cues.
Integrated kinematic and video data within a unified framework.

Main Results:

The proposed MsM-CRF model demonstrated improved performance over standard Markov or semi-Markov CRFs using video data alone.
Results using kinematic data alone were comparable to state-of-the-art methods.
Combining kinematic and video data led to significant improvements over state-of-the-art methods.

Conclusions:

The joint segmentation and recognition framework effectively utilizes both kinematic and video data for robotic surgery.
This approach offers a more robust and accurate method for analyzing surgical gestures.
The findings have implications for advancing automated feedback systems in surgical training.