Related Experiment Video
Updated: Mar 22, 2026
07:46
Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
Published on: August 9, 2024
1.2K
Gesture-Controlled Image Management for Operating Room: A Randomized Crossover Study to Compare Interaction Using
Rolf Wipfli1, Victor Dubois-Ferrière2, Sylvain Budry3
1Division of Medical Information Sciences, Geneva University Hospitals, Geneva, Switzerland.
Plos One
|April 16, 2016
Summary
Gesture control is more efficient and satisfying than verbal instructions for surgical image manipulation, offering a viable alternative when a mouse cannot be used. This study formally evaluated three interaction modes.
Area of Science:
- Medical technology
- Human-computer interaction
- Surgical informatics
Background:
- Effective image manipulation is crucial in surgical settings.
- Traditional methods like mouse use may be impractical during procedures.
- Exploring alternative interaction modes is essential for improving surgical workflow.
Purpose of the Study:
- To formally compare three image manipulation interaction modes in a surgical context: gesture control (Kinect®), oral instructions to a third party, and direct mouse manipulation.
- To evaluate efficiency, effectiveness, and user satisfaction for each mode.
Main Methods:
- A randomized controlled trial was conducted with 30 physicians and medical students.
- Participants used the Weasis radiology image viewer with three interaction modes in a crossover design.
- Nine standardized scenarios were employed to assess performance and gather feedback.
Main Results:
- Gesture control was more efficient (214.97s) and satisfying (5.77) than oral instructions (246.33s, 4.40).
- Mouse manipulation was the most efficient (109.10s) and satisfying (6.63), but often impractical during surgery.
- No significant differences in effectiveness (error rates) were found between the modes.
Conclusions:
- Gesture control is a superior alternative to oral instructions for surgical image manipulation.
- The tested gesture system demonstrated ease of learning and good reliability.
- Gesture control offers a practical and effective solution for image manipulation when direct mouse use is not feasible during surgery.
