Related Experiment Video
Updated: Jun 19, 2026

06:18
Pedicle Screw Placement Using an Augmented Reality Head-Mounted Display in a Porcine Model
Published on: May 24, 2024
Dex-ray: augmented reality neurosurgical navigation with a handheld video probe
Ralf A Kockro1, Yeo Tseng Tsai, Ivan Ng
1Department of Neurosurgery, University Hospital Zürich, Zürich, Switzerland. RalfAlfons.kockro@usz.ch
Neurosurgery
|October 17, 2009
Summary
We developed DEX-Ray, an augmented reality system for intraoperative image guidance. This system enhances surgical navigation by overlaying 3D graphics onto a video stream, improving understanding of anatomy.
Area of Science:
- Neurosurgery
- Medical Imaging
- Augmented Reality
Background:
- Developing advanced intraoperative image guidance systems is crucial for improving surgical outcomes.
- Augmented reality (AR) offers a promising approach to overlay digital information onto the real-world surgical field.
Observation:
- The DEX-Ray system integrates a tracked handheld probe with a video camera, augmenting the video stream with 3D graphics from neurosurgical planning.
- The probe serves as both a navigation and interaction device for adjusting the 3D graphics.
Findings:
- DEX-Ray provides accurate, real-time, video-based augmented reality, seamlessly integrating into surgical workflows.
- The 'see-through' effect revealing subsurface 3D information was highly valuable for macroscopic surgical phases.
- Limitations were noted in deep/narrow corridors due to camera resolution and light sensitivity.
Implications:
- The augmented reality system enhances surgical navigation by providing direct understanding of anatomy beyond the visible surface.
- DEX-Ray offers improved navigational experiences and direct guidance toward surgical targets in neurosurgery.

