Related Experiment Video
Updated: Sep 14, 2026

Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
Next viewer-development of a software for the spatial computing data glasses apple vision pro for patient-specific
Conrad Günther1, Dirk Winkler1, Svenja Jung1
1Department of Neurosurgery, University Hospital Leipzig, Leipzig, Germany.
Objective:
This study aims to evaluate the clinical utility of nextViewer, a novel spatial computing application for the Apple Vision Pro, to determine its efficacy in enhancing patient-specific neurosurgical preoperative planning, spatial comprehension, and multi-user team communication.
Methods:
A complete translational workflow was established, encompassing the segmentation of high-resolution CT/MRI scans into patient-specific 3D models and their integration into the spatial computing environment. The software leverages integrated eye- and hand-tracking to enable controller-free interaction, including 3D model manipulation, surgical trajectory drawing, and multiplanar finger-navigation. A systematic clinical evaluation was conducted with 15 experienced neurosurgeons. User satisfaction regarding user-friendliness, surgical planning benefits, system stability, and visualization quality was assessed utilizing a Likert-scale questionnaire ranging from -2 (strongly disagree) to +2 (strongly agree).
Results:
The application successfully facilitated intuitive, real-time manipulation of complex anatomical models, utilizing transparencies to visualize underlying critical structures. The finger-navigation feature-providing immediate crosshair updates in corresponding coronal, sagittal, and axial planes-was identified as a unique selling point for spatial orientation. Furthermore, the collaboration mode enabled synchronized, multi-user case discussions. The systematic evaluation yielded a highly positive total score of +1.7. Surgeons specifically highlighted the controller-free interaction and the exceptional graphical resolution as significant advantages over legacy visualization systems.
Conclusions:
Controller-free spatial computing via the Apple Vision Pro significantly enhances neurosurgical preoperative planning. By improving real-time spatial awareness and enabling seamless interactive simulations, the nextViewer app bridges the gap between theoretical augmented reality concepts and practical clinical application. The system demonstrates strong potential to become a standard tool in neurosurgery, establishing a robust foundation for future integration with telemedicine and advanced surgical navigation.

