Related Experiment Video
Updated: Mar 24, 2026
13:44
Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
Published on: August 8, 2011
14.7K
Gesture-Controlled Interface for Contactless Control of Various Computer Programs with a Hooking-Based Keyboard and
Ben Joonyeon Park1, Taekjin Jang2, Jong Woo Choi3
1Medical Information Development Team, Asan Medical Center, Seoul 05505, Republic of Korea.
Computational and Mathematical Methods in Medicine
|March 17, 2016
Summary
Gesture control offers a faster, safer way for surgeons to interact with medical images during operations. This contactless interface significantly improves efficiency compared to traditional mouse controls.
Area of Science:
- Medical Imaging
- Human-Computer Interaction
- Surgical Technology
Background:
- Operating room image control often relies on cumbersome methods.
- Efficient image manipulation is crucial for surgical decision-making and workflow.
Purpose of the Study:
- To develop and evaluate a contactless hand gesture interface for controlling medical images in the operating room.
- To assess the efficiency and accuracy of the gesture-based system compared to traditional mouse control.
Main Methods:
- Developed an in-house program, GestureHook, utilizing message hooking techniques to translate hand gestures into commands.
- Quantitatively evaluated GestureHook using a dynamic biliary CT study, comparing gesture control time with mouse control.
- Assessed gesture recognition and task success rates in simulated clinical scenarios.
Main Results:
- Gesture control was significantly faster than mouse control (5.29 ± 1.00s vs. 8.54 ± 1.77s, p < 0.001).
- The system demonstrated high recognition and success rates in clinical scenarios.
- Seamless control of multiple image viewing programs (PACS, 3D PACS, basic viewer) was achieved without source code modification.
Conclusions:
- The developed gesture control interface provides an effective and efficient contactless solution for medical image manipulation in the operating room.
- This technology enhances surgical workflow by enabling safe and intuitive image browsing and application switching.
- GestureHook offers a versatile tool applicable to various operating room programs, improving surgeon interaction with visual data.
