Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Machines01:19

Machines

573
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. One example of a machine is the cutting plier, which is used to cut wires by applying forces to its handles. When equal and opposite forces are exerted on the handles of the cutting plier, they cause the cutting edges to come together and apply equal and opposite reaction forces on the wire, which are greater than the applied forces.
A free-body diagram of the...
573
Machines: Problem Solving II01:30

Machines: Problem Solving II

661
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
661
Machines: Problem Solving I01:22

Machines: Problem Solving I

709
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
709
Avoidance Learning and Learned Helplessness01:14

Avoidance Learning and Learned Helplessness

2.6K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.6K
Sequence Networks of Rotating Machines01:24

Sequence Networks of Rotating Machines

486
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
486
Simplified Synchronous Machine Model01:30

Simplified Synchronous Machine Model

769
The Synchronous Machine Model is a fundamental tool in analyzing and ensuring the transient stability of power systems. This model simplifies the representation of a synchronous machine under balanced three-phase positive-sequence conditions, assuming constant excitation and ignoring losses and saturation. The model is pivotal for understanding the behavior of synchronous generators connected to a power grid, particularly during transient events.
In this model, each generator is connected to a...
769

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Surg-NAT+: negation-aware vision-language refinement for fine-grained surgical understanding.

International journal of computer assisted radiology and surgery·2026
Same author

GEN-Guard: correcting generalization failures for deployable federated surgical AI.

International journal of computer assisted radiology and surgery·2026
Same author

Endoshare: a publicly available, surgeons-friendly solution to de-identify and manage surgical videos.

Surgical endoscopy·2026
Same author

S4M: 4-points to segment anything.

International journal of computer assisted radiology and surgery·2026
Same author

Video-based assessment tool for workflow analysis in minimally invasive colorectal surgery: expert consensus-based development and multicentre validation of ColoWorkflow.

BJS open·2026
Same author

Current validation practice undermines surgical AI development.

ArXiv·2026

Related Experiment Video

Updated: Jan 28, 2026

A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data
09:34

A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data

Published on: September 25, 2021

4.5K

Machine and deep learning for workflow recognition during surgery.

Nicolas Padoy1

  • 1a ICube, IHU Strasbourg, CNRS , University of Strasbourg , Strasbourg , France.

Minimally Invasive Therapy & Allied Technologies : MITAT : Official Journal of the Society for Minimally Invasive Therapy
|March 9, 2019
PubMed
Summary
This summary is machine-generated.

This article reviews how artificial intelligence, specifically machine and deep learning, can automatically identify surgical activities in real-time using video footage from operating rooms to improve surgical team performance.

Keywords:
Activity recognitionRGB-D videoclinician pose estimationendoscopic videooperating roomsurgical control towersurgical workflowtool detectioncomputer visiondeep learningoperating roommedical imaging

Frequently Asked Questions

More Related Videos

Author Spotlight: Efficient Image Recognition Using Directional Gradient Histogram Technique and Support Vector Machines
08:27

Author Spotlight: Efficient Image Recognition Using Directional Gradient Histogram Technique and Support Vector Machines

Published on: January 5, 2024

1.6K
Novel Object Recognition Test for the Investigation of Learning and Memory in Mice
08:52

Novel Object Recognition Test for the Investigation of Learning and Memory in Mice

Published on: August 30, 2017

77.3K

Related Experiment Videos

Last Updated: Jan 28, 2026

A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data
09:34

A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data

Published on: September 25, 2021

4.5K
Author Spotlight: Efficient Image Recognition Using Directional Gradient Histogram Technique and Support Vector Machines
08:27

Author Spotlight: Efficient Image Recognition Using Directional Gradient Histogram Technique and Support Vector Machines

Published on: January 5, 2024

1.6K
Novel Object Recognition Test for the Investigation of Learning and Memory in Mice
08:52

Novel Object Recognition Test for the Investigation of Learning and Memory in Mice

Published on: August 30, 2017

77.3K

Area of Science:

  • Artificial intelligence applications within surgical workflow recognition
  • Computer vision research in medical imaging

Background:

No prior work had resolved the full potential of integrating automated video analysis into modern surgical environments. That uncertainty drove researchers to investigate how computer vision might support medical teams. Prior research has shown that digital transformation in healthcare settings creates vast amounts of visual data. This gap motivated the exploration of intelligent systems for real-time activity tracking during procedures. It was already known that artificial intelligence techniques have advanced rapidly in general object detection tasks. However, applying these sophisticated models to the complex, dynamic environment of an operating room remained challenging. Scientists sought to bridge the divide between theoretical computational progress and practical clinical utility. This review addresses the current state of automated surgical context awareness and its implications for future assistance tools.

Purpose Of The Study:

The aim of this review is to describe how machine and deep learning techniques facilitate the recognition of surgical workflows. Researchers address the challenge of creating assistance tools that remain aware of the context within an operating room. This motivation stems from the need to enhance the performance and abilities of surgical teams through digital innovation. The authors explore how recent progress in computer vision can be applied to videos captured during medical procedures. They investigate the utility of different camera perspectives, including endoscopic and ceiling-mounted options. The study seeks to clarify how these intelligent systems interpret the various activities occurring throughout a surgery. By presenting current developments, the authors provide a clear view of the potential for automated surgical support. This work bridges the gap between advanced computational research and practical clinical implementation in modern healthcare settings.

Main Methods:

The review approach involves a systematic examination of recent computational techniques for analyzing surgical video data. Researchers evaluated various machine learning architectures capable of processing temporal information from operating room recordings. The study design focuses on comparing different input sources, specifically endoscopic versus ceiling-mounted camera perspectives. Investigators assessed how these models interpret complex sequences of events during medical procedures. The review approach prioritizes methods that enable real-time processing of visual streams. Authors synthesized findings from multiple studies to illustrate the current capabilities of these intelligent systems. The analysis covers the transition from basic object detection to comprehensive activity recognition. This methodology provides a structured overview of the computational strategies currently applied to surgical context awareness.

Main Results:

Key findings from the literature indicate that machine learning models can successfully identify surgical activities in real-time. The review highlights that deep learning architectures are particularly effective at interpreting the complex visual data captured during operations. Evidence suggests that both endoscopic and ceiling-mounted camera feeds provide sufficient information for accurate workflow recognition. The literature shows that these systems can enhance the performance of surgical teams by providing context-aware assistance. Findings demonstrate that recent progress in computer vision directly translates to improved capabilities for automated surgical tools. The review notes that researchers at the University of Strasbourg are actively developing two clinical applications based on these techniques. Data from the literature confirms that the digitalization of the operating room facilitates the deployment of these intelligent assistance systems. Results indicate that the integration of these models is a promising development for future surgical support.

Conclusions:

The authors propose that machine learning models offer a pathway to improved surgical team performance through real-time awareness. Synthesis and implications suggest that context-aware systems could eventually provide tailored assistance during complex procedures. The researchers indicate that video-based recognition serves as a foundation for next-generation operating room technologies. Their review highlights that both endoscopic and ceiling-mounted perspectives provide valuable data for these computational frameworks. The authors suggest that ongoing development at the University of Strasbourg demonstrates the feasibility of these clinical applications. They emphasize that successful implementation requires robust integration of algorithmic outputs into the surgical workflow. The review implies that future progress depends on refining these models to handle the variability of real-world surgical environments. The authors conclude that these tools represent a significant shift toward intelligent, data-driven surgical support systems.

The researchers propose that machine learning algorithms identify surgical activities by analyzing video streams from endoscopic or ceiling-mounted cameras. This process enables the system to maintain awareness of the ongoing context, which is necessary for providing efficient assistance to the surgical team during procedures.

The authors utilize deep learning architectures, which are advanced computational models capable of processing complex visual information. These tools are specifically designed to interpret the dynamic activities occurring within an operating room, distinguishing them from simpler, traditional image processing methods used in earlier studies.

The researchers note that high-quality video input is necessary for accurate recognition. They compare endoscopic views, which provide a close-up perspective of the surgical site, with ceiling-mounted camera feeds, which offer a broader view of the entire operating room environment and staff movements.

The authors explain that video data serves as the primary input for training and testing these models. This visual information allows the system to learn the temporal patterns of surgical tasks, which is a role distinct from static image analysis or manual data entry methods.

The researchers measure the effectiveness of these systems by their ability to perform real-time recognition of activities. This phenomenon is evaluated against the complex, multi-tasking nature of surgical procedures, where the system must correctly identify transitions between different phases of the operation.

The authors suggest that these technologies will enhance the performance of surgical teams. They propose that by providing context-aware support, these systems could reduce cognitive load, contrasting this with current manual systems that lack the ability to automatically track the progress of a procedure.