Related Experiment Video
Updated: May 14, 2026
10:25
Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
A portable immersive surgery training system using RGB-D sensors.
Xinqing Guo1, Luis D Lopez, Zhan Yu
1University of Delaware, DE, USA.
Studies in Health Technology and Informatics
|February 13, 2013
Summary
This study introduces an immersive surgical training system using 3D reconstructions for better skill development. This novel approach offers enhanced depth and interactivity compared to traditional video methods, improving surgical education.
Area of Science:
- Medical Education
- Computer Science
- Surgical Technology
Background:
- Effective surgical training is crucial for resident skill development but remains challenging.
- Current video-based training lacks depth perception and interactivity.
- Limitations of traditional methods hinder comprehensive surgical skill acquisition.
Purpose of the Study:
- To introduce a portable immersive surgical training system.
- To enable high-fidelity 3D reconstructions of surgical procedures.
- To enhance surgical training with interactive 3D exploration.
Main Methods:
- Utilized Microsoft Kinect sensors for simultaneous 3D reconstruction of participants, environment, and surgical scenes.
- Developed a space-time navigator for immersive exploration of recorded procedures.
- Integrated 3D reconstruction and interactive playback for training.
Main Results:
- The system successfully acquired and displayed high-fidelity 3D reconstructions of surgical procedures.
- The space-time navigator allowed trainees to explore procedures immersively.
- Preliminary resident feedback indicated superior effectiveness compared to videotaped systems.
Conclusions:
- The developed immersive system significantly enhances surgical training effectiveness.
- 3D reconstruction and interactive exploration offer advantages over traditional methods.
- This technology represents a promising advancement in surgical education and skill development.
