Related Experiment Video
Updated: May 13, 2026
Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
A novel augmented reality system of image projection for image-guided neurosurgery
Mehran Mahvash1, Leila Besharati Tabrizi
1Department of Neurosurgery, Clinic of Cologne-Merheim, University of Witten-Herdecke, Ostmerheimer Strasse 200, 51109, Köln, Germany. mmahvash@yahoo.de
Background:
Augmented reality systems combine virtual images with a real environment.
Objective:
To design and develop an augmented reality system for image-guided surgery of brain tumors using image projection.
Methods:
A virtual image was created in two ways: (1) MRI-based 3D model of the head matched with the segmented lesion of a patient using MRIcro software (version 1.4, freeware, Chris Rorden) and (2) Digital photograph based model in which the tumor region was drawn using image-editing software. The real environment was simulated with a head phantom. For direct projection of the virtual image to the head phantom, a commercially available video projector (PicoPix 1020, Philips) was used. The position and size of the virtual image was adjusted manually for registration, which was performed using anatomical landmarks and fiducial markers position.
Results:
An augmented reality system for image-guided neurosurgery using direct image projection has been designed successfully and implemented in first evaluation with promising results. The virtual image could be projected to the head phantom and was registered manually. Accurate registration (mean projection error: 0.3 mm) was performed using anatomical landmarks and fiducial markers position.
Conclusions:
The direct projection of a virtual image to the patients head, skull, or brain surface in real time is an augmented reality system that can be used for image-guided neurosurgery. In this paper, the first evaluation of the system is presented. The encouraging first visualization results indicate that the presented augmented reality system might be an important enhancement of image-guided neurosurgery.
