Related Experiment Video
Updated: Jul 15, 2025

Pedicle Screw Placement Using an Augmented Reality Head-Mounted Display in a Porcine Model
Published on: May 24, 2024
Application of Glasses-Free Augmented Reality Localization in Neurosurgery
Yahui Cui1, Yupeng Zhou1, Haipeng Zhang1
1Department of Neurosurgery, Hangzhou Xixi Hospital Affiliated to Zhejiang University School of Medicine, Hangzhou, China.
Objective:
The accurate localization of intracranial lesions is critical in neurosurgery. Most surgeons locate the vast majority of neurosurgical sites through skull surface markers, combined with neuroimaging examination and marking lines. This project's primary purpose was to develop an augmented reality (AR) technology or tool that can be used for surgical positioning using the naked eye.
Methods:
Brain models were predesigned with intracranial lesions using computerized tomography scan, and Digital Imaging and Communications in Medicine data were segmented and modeled by 3D slicer software. The processed data were imported into a smartphone 3D viewing software application (Persp 3D) and were used by a Remebot surgical robot. The localization of intracranial lesions was performed, and the AR localization error was calculated compared with standard robot localization.
Results:
After mastering the AR localization registration method, surgeons achieved an average localization error of 1.39 ± 0.82 mm.
Conclusions:
The error of AR positioning technology in surgical simulation tests based on brain modeling was millimeter level, which has verified the feasibility of clinical application. More efficient registration remains a need that should be addressed.

