Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: May 28, 2026

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

Learning gestures for customizable human-computer interaction in the operating room.

Loren Arthur Schwarz1, Ali Bigdelou, Nassir Navab

  • 1Computer Aided Medical Procedures, Technische Universität München, Germany. schwarz@cs.tum.edu

Medical Image Computing and Computer-Assisted Intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention
|October 19, 2011
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Erratum for: Associations of MRI-derived Paraspinal IMAT and LMM with Cardiometabolic Risk Factors: Results from a German Cohort.

Radiology·2026
Same author

ProtoFlow: interpretable and robust surgical workflow modeling with learned dynamic scene graph prototypes.

International journal of computer assisted radiology and surgery·2026
Same author

Toward comprehensive real-time scene understanding in ophthalmic surgery through multimodal image fusion.

International journal of computer assisted radiology and surgery·2026
Same author

DefSynUS: Real-time patient-specific intrahepatic vessel identification via deformation-aware CT-US domain adaptation.

International journal of computer assisted radiology and surgery·2026
Same author

Smartphone photogrammetry for rapid 3D surface modeling of head and neck specimens to support frozen section communication: A feasibility pilot study.

Oral oncology·2026
Same author

Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesis.

Proceedings. IEEE Computer Society Conference on Computer Vision and Pattern Recognition·2026

Surgeons can now control operating room devices using custom gestures learned by a new system. This method uses body-worn sensors for robust, camera-free gesture recognition, improving surgical workflow.

Area of Science:

  • Medical technology
  • Human-computer interaction
  • Surgical robotics

Background:

  • Operating room device interaction is challenging for surgeons due to sterility and procedural complexity.
  • Current methods, like assistant delegation, are often inefficient.
  • Need for intuitive, sterile, and customizable surgical interface solutions.

Purpose of the Study:

  • To develop a customizable gesture-based interaction method for operating room medical devices.
  • To enable surgeons to control devices using personalized gestures.
  • To enhance surgical workflow efficiency and precision.

Main Methods:

  • Utilizing wireless body-worn inertial sensors to capture surgeon's movements.
  • Learning low-dimensional manifold models from training gesture examples.

Related Experiment Videos

Last Updated: May 28, 2026

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

  • Implementing a component-based framework for device integration.
  • Developing gesture recognition and pose tracking algorithms.
  • Main Results:

    • The system robustly recognizes learned, customized gestures.
    • The method effectively distinguishes learned gestures from other movements.
    • Demonstrated feasibility of camera-free, occlusion-resilient gesture control.

    Conclusions:

    • The proposed gesture-based interaction method offers a viable solution for sterile, customizable control of medical devices.
    • This approach enhances surgeon-device interaction, potentially improving operating room efficiency and safety.
    • The system's adaptability and robustness pave the way for advanced surgical interfaces.