Related Experiment Video
Updated: Jun 13, 2026

07:22
Surgical Robot-Assisted Transanal Specimen Extraction Radical Sigmoidectomy Without an Auxiliary Abdominal Incision
Published on: June 13, 2025
Task versus subtask surgical skill evaluation of robotic minimally invasive surgery
Carol E Reiley1, Gregory D Hager
1Department of Computer Science, Johns Hopkins University, Baltimore, MD 21218, USA. creiley@jhu.edu
Summary
This study compares two methods for evaluating surgical skill using motion data. Hidden Markov Models at the task or gesture (surgeme) level accurately identified skill levels, with surgeme models offering more detailed insights.
Area of Science:
- Robotics
- Surgical Technology
- Machine Learning
Background:
- Surgical skill evaluation is challenging, often subjective and time-consuming.
- Objective methods using motion data are needed for accurate skill assessment.
- The da Vinci surgical system provides rich data for skill analysis.
Purpose of the Study:
- To compare two distinct methods for identifying surgical skill levels from motion data.
- To evaluate the efficacy of task-level versus gesture-level Hidden Markov Models (HMMs).
- To determine the feasibility of automated surgical skill assessment.
Main Methods:
- Development of discrete Hidden Markov Models (HMMs) at the overall task level.
- Development of discrete HMMs for specific surgical gestures, termed 'surgemes'.
- Application and comparison of both HMM approaches to 57 da Vinci surgical system datasets.
Main Results:
- Task-level HMMs achieved 100% accuracy with known gesture segmentation and 95% with unknown segmentation.
- Surgeme-level HMMs demonstrated 100% accuracy in skill level identification.
- Surgeme models required less prior labeling data and provided more granular performance insights.
Conclusions:
- Both task-level and surgeme-level HMMs are effective for automated surgical skill evaluation.
- Surgeme-level analysis offers a more detailed understanding of individual surgical performance.
- Automated methods using HMMs can overcome the limitations of traditional subjective skill assessment.
