Related Experiment Video
Updated: Apr 12, 2026
Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
A gesture-controlled projection display for CT-guided interventions
A Mewes1, P Saalfeld2,3, O Riabikin4
1Computer-Assisted Surgery Group, Faculty of Computer Science, Institute of Simulation and Graphics, University of Magdeburg, PF 4120, 39106, Magdeburg, Germany. andre.mewes@ovgu.de.
Physicians can now control intervention software directly using a new gesture-controlled projection display during computed tomography (CT) interventions. This system enhances physician-machine interaction in sterile environments, offering intuitive control for improved workflow.
Area of Science:
- Medical Imaging
- Human-Computer Interaction
- Interventional Radiology
Background:
- Physician-machine interaction during interventional imaging is limited by sterile environments and workspace restrictions.
- Direct control of intervention software is challenging in computed tomography (CT)-based procedures.
Purpose of the Study:
- To develop and evaluate a gesture-controlled projection display for natural physician-machine interaction during CT interventions.
- To enable direct control of intervention software within a sterile environment.
Main Methods:
- A projection display was developed, projecting a graphical user interface onto a radiation shield.
- Hand gestures were captured and classified using a Leap Motion Controller.
- A gesture set for 2D image exploration and 3D object manipulation was proposed and evaluated in a user study with 12 participants.
Main Results:
- The gesture-controlled display and interaction concept were accepted by clinical users.
- Gesture recognition was robust, with potential for improvement.
- Gesture training was rapid (under 10 minutes), and gestures were intuitive and logically linked to software functions.
Conclusions:
- The gesture-controlled projection display provides radiologists with full control of intervention software.
- This technology offers new avenues for direct physician-machine interaction in CT-based interventions.
- The system is suitable for integration into future interventional suites.
