Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Deconvolution of 1D NMR spectra: A deep learning-based approach.

Journal of magnetic resonance (San Diego, Calif. : 1997)·2022
Same author

Usage of a graph database for the selection of sterile items in the OR.

International journal of computer assisted radiology and surgery·2022
Same author

[The importance of microbiological results for the treatment of complicated appendicitis-a monocentric case-control study].

Chirurgie (Heidelberg, Germany)·2022
Same author

Surgical reporting for laparoscopic cholecystectomy based on phase annotation by a convolutional neural network (CNN) and the phenomenon of phase flickering: a proof of concept.

International journal of computer assisted radiology and surgery·2022
Same author

[Clinical value of alternative technologies to standard laparoscopic cholecystectomy - single port, reduced port, robotics, NOTES].

Chirurgie (Heidelberg, Germany)·2022
Same author

Effect of a newly developed pastille on the salivary flow rate in subjects with dry mouth symptoms: a randomized, controlled, monocentric clinical study.

BMC oral health·2021
Same journal

[Timing of the closure of ileostomy after low anterior rectal resection for rectal cancer: results of a meta-analysis].

Chirurgie (Heidelberg, Germany)·2026
Same journal

[Defect coverage on the hand : A reconstructive challenge].

Chirurgie (Heidelberg, Germany)·2026
Same journal

Chirurgie (Heidelberg, Germany)·2026
Same journal

[Massive/mass-forming ductular reaction (MDR) in angioinvasive hepatocellular carcinoma : Pathogenesis and differential diagnoses of a hepatic pseudotumor].

Chirurgie (Heidelberg, Germany)·2026
Same journal

[Esophageal NEN: update on diagnostics and surgical treatment].

Chirurgie (Heidelberg, Germany)·2026
Same journal

[Working conditions in endocrine surgery : A study among participants of the 43rd annual conference of the Surgical Working Group Endocrinology].

Chirurgie (Heidelberg, Germany)·2026
See all related articles

Related Experiment Video

Updated: Sep 6, 2025

Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
10:23

Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation

Published on: September 2, 2025

8

[Image-based supportive measures for future application in surgery].

R Hartwig1, M Berlet1,2, T Czempiel3

  • 1Forschungsgruppe MITI, Klinik und Poliklinik für Chirurgie, Klinikum rechts der Isar, Technische Universität München, München, Deutschland.

Chirurgie (Heidelberg, Germany)
|June 23, 2022
PubMed
Summary
This summary is machine-generated.

This article reviews how camera-based technologies and artificial intelligence help surgeons perform tasks more effectively. It explores current tools that track surgical steps and future systems that will guide robotic cameras. The authors explain that combining visual data with other sensors is necessary to ensure safety and reliability in complex medical procedures.

Keywords:
Artificial intelligenceAutonomyCognitive operating roomDigitalizationRoboticssurgical roboticsartificial intelligencecomputer visionautonomous surgerysensor fusion

Frequently Asked Questions

More Related Videos

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions
06:18

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Published on: April 5, 2024

1.2K
Author Spotlight: 3D Scanning and Augmented Reality for Enhanced Cancer Surgery Communication
07:47

Author Spotlight: 3D Scanning and Augmented Reality for Enhanced Cancer Surgery Communication

Published on: December 15, 2023

806

Related Experiment Videos

Last Updated: Sep 6, 2025

Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
10:23

Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation

Published on: September 2, 2025

8
Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions
06:18

Author Spotlight: Segmentation and VR for Advanced Neurovascular Interventions

Published on: April 5, 2024

1.2K
Author Spotlight: 3D Scanning and Augmented Reality for Enhanced Cancer Surgery Communication
07:47

Author Spotlight: 3D Scanning and Augmented Reality for Enhanced Cancer Surgery Communication

Published on: December 15, 2023

806

Area of Science:

  • Surgical robotics and image-based supportive measures within biomedical engineering
  • Computer vision applications in clinical medicine

Background:

No prior work had resolved how visual sensor systems might fully integrate into autonomous surgical workflows. It was already known that comprehensive situational awareness serves as the foundation for independent machine actions. Prior research has shown that video-based platforms possess unique capabilities for monitoring clinical environments. That uncertainty drove the need to evaluate both the strengths and constraints of these digital tools. This gap motivated a closer look at how current technologies perform during complex medical interventions. Scholars have previously identified that phase recognition relies heavily on deep learning architectures. However, the transition from simple monitoring to active robotic assistance remains a significant hurdle for current engineering teams. This review synthesizes existing evidence to clarify the current state of visual guidance in the operating room.

Purpose Of The Study:

The aim of this study is to present the central aspects of image-based support systems currently being developed for surgical applications. Researchers intend to clarify the potential benefits and the inherent limitations of these emerging technologies. The authors seek to explain how video-based systems contribute to the comprehensive perception of the actual surgical situation. This work addresses the challenge of adapting sensor reliability to the rigorous demands of the operating theater. The study explores how neural networks facilitate the phase detection of various medical interventions. The team investigates the future role of autonomous navigation for laparoscopic camera guidance systems. The motivation for this research stems from the increasing importance of assistive technologies in modern clinical practice. This paper provides a clear framework for understanding how visual data can be integrated into future autonomous surgical workflows.

Main Methods:

The review approach synthesizes findings from existing literature and ongoing research projects to evaluate current visual assistance technologies. Investigators examined the capabilities of various sensor systems used to monitor clinical activities. The study design focuses on the transition from passive observation to active robotic guidance within the operating room. Researchers analyzed how neural networks process surgical footage to identify distinct procedural phases. The methodology involved comparing traditional video analysis with newer, time-based and transformative predictive techniques. Experts also assessed the integration of visual data with secondary sensor modalities for improved navigation. The team evaluated the reliability of these tools against the strict safety requirements of modern surgical practice. This systematic assessment provides a comprehensive overview of both the potential and the current limitations of visual technology in medicine.

Main Results:

Key findings from the literature demonstrate that phase detection accuracy has significantly improved through recent temporal and transformative analytical methods. The authors report that video-based systems provide a strong foundation for understanding the actual surgical situation. Research indicates that robotic camera guidance will soon utilize these visual inputs to navigate laparoscopes autonomously. The data show that current implementations already combine video analysis with other sensor modalities for localization tasks. The literature confirms that image-based methods are currently available for various specific surgical assignments. However, the evidence suggests that these systems must be embedded within multimodal frameworks to provide necessary security. The findings highlight that reliability remains a primary challenge when adapting these tools to high-stakes surgical environments. The review notes that the development of such assistive technologies is gaining importance across multiple medical disciplines.

Conclusions:

The authors propose that visual systems must integrate with diverse sensor inputs to achieve reliable autonomous performance. Future surgical environments will likely depend on these combined modalities to maintain high safety standards. The researchers suggest that current limitations in image processing require robust data fusion strategies for clinical success. This synthesis indicates that autonomous navigation of laparoscopic tools is a realistic goal for upcoming medical technology. The evidence highlights that phase detection accuracy has improved through recent temporal and transformative analytical techniques. Authors maintain that the reliability of these digital assistants must match the rigorous demands of modern operating theaters. This review implies that image-based support will evolve from simple observation to active, secure participation in surgical tasks. The findings confirm that multimodal integration represents the most viable path toward fully autonomous surgical support systems.

The researchers propose that combining visual data with diverse sensor modalities provides the necessary security for autonomous functions. Unlike single-source systems, this multimodal approach ensures higher reliability during complex laparoscopic procedures compared to isolated video analysis.

The authors highlight neural networks as the primary tool for phase detection. These computational models analyze surgical footage to identify specific intervention steps, offering a more precise temporal understanding than traditional observation methods.

The authors state that integrating additional sensor information is necessary to meet the high reliability requirements of surgery. This necessity arises because raw video data alone may lack the precision required for fully autonomous navigation.

Video data serves as the primary input for identifying surgical phases and guiding robotic cameras. By processing these images, the system gains the situational awareness required to perform tasks without constant human intervention.

The researchers measure success through the improved accuracy of phase prediction. Recent advancements in time-based and transformative analysis have significantly enhanced these results compared to earlier, less sophisticated detection models.

The authors claim that image-based support will become a standard aspect of future surgery. They suggest that embedding these methods into multimodal frameworks will allow for the safe implementation of autonomous robotic functions.