Related Experiment Video
Updated: Dec 25, 2025

Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
Assessing performance of augmented reality-based neurosurgical training
Wei-Xin Si1, Xiang-Yun Liao1, Yin-Ling Qian1
1Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, 1068 Xueyuan Avenue, Shenzhen University Town, Shenzhen, 518055, China.
This study introduces an augmented reality (AR) neurosurgery simulator for training. The system enhances surgical precision and efficiency through holographic guidance and haptic feedback during simulated procedures.
Area of Science:
- Neurosurgery
- Medical Simulation
- Augmented Reality (AR)
Background:
- Neurosurgical training requires advanced simulation tools for skill acquisition.
- Current simulators may lack realistic anatomical visualization and haptic feedback.
- Augmented reality offers potential for immersive and interactive surgical training.
Purpose of the Study:
- To develop and validate a novel augmented reality (AR)-based neurosurgical training simulator.
- To integrate bimanual haptic interaction for realistic surgical simulation.
- To evaluate the accuracy and effectiveness of AR guidance in neurosurgery training.
Main Methods:
- Patient-specific anatomy reconstruction from segmented brain magnetic resonance imaging (MRI).
- Development of a precise registration method for overlaying virtual 3D anatomy onto the real surgical field.
- Integration of bimanual haptic feedback within a holographic environment for simulating procedures like brain tumor resection.
- Validation through AR-based guidance testing and a user study.
Main Results:
- The developed AR neurosurgery simulator demonstrated high accuracy in overlaying anatomical information.
- User study indicated the AR guidance mode's potential to simplify and improve surgical operations.
- The simulator effectively mimicked real brain tumor resection with haptic feedback.
- Observed improvements include reduced operational difficulty, shortened operation times, and increased precision.
Conclusions:
- The AR-based neurosurgery simulator provides a natural and effective training environment.
- AR guidance significantly enhances surgical precision and efficiency.
- This technology holds considerable promise for advancing neurosurgical education and practice.

