Related Experiment Video
Updated: Apr 23, 2026
10:25
Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
638
Gesture-controlled interactive three dimensional anatomy: a novel teaching tool in head and neck surgery
Jordan B Hochman1, Bertram Unger2, Jay Kraut3
1Neurotologic Surgery, Department of Otolaryngology - Head and Neck Surgery, Faculty of Medicine, University of Manitoba, GB421, 820 Sherbrook Street, Winnipeg, Manitoba Canada.
Summary
This study introduces a novel 3D temporal bone anatomy model controlled by hand gestures using the Microsoft Kinect™. This innovative tool offers an interactive alternative to traditional anatomical education methods.
Area of Science:
- Medical Education Technology
- Anatomical Visualization
- Human-Computer Interaction
Background:
- Traditional anatomy teaching tools require enhancement.
- A need exists for innovative, interactive anatomical models.
- Three-dimensional (3D) visualization offers advanced learning opportunities.
Purpose of the Study:
- To describe a novel 3D temporal bone anatomy teaching tool.
- To demonstrate gesture-based manipulation of 3D anatomical models.
- To evaluate the efficacy of a Kinect™-based interface for anatomical education.
Main Methods:
- CT temporal bone data was segmented and exported to a 3D graphics engine.
- A Microsoft Kinect™ sensor was integrated for gesture recognition.
- Hand position tracking controlled motion within the virtual 3D environment.
Main Results:
- The system successfully tracked depth and user joint locations for gesture control.
- Stereoscopic display provided detailed visualization of anatomical structures.
- Users could select, extract, and rotate individual anatomical components.
- Voice command integration was explored but found susceptible to noise.
Conclusions:
- Virtual anatomy models are valuable complements to traditional education.
- Gesture-controlled 3D models offer a promising new interface for anatomy teaching.
- Despite initial time investment, this novel approach enhances anatomical learning.
