Related Experiment Video
Updated: Jul 23, 2025

06:18
Pedicle Screw Placement Using an Augmented Reality Head-Mounted Display in a Porcine Model
Published on: May 24, 2024
2.2K
Validation of real-time inside-out tracking and depth realization technologies for augmented reality-based
Yun-Sik Dho1, Byeong Cheol Lee2, Hyeong Cheol Moon3
1Neuro-Oncology Clinic, National Cancer Center, Goyang, Republic of Korea.
Summary
This study introduces METAMEDIP navigation, a novel augmented reality system for brain surgery. It features advanced tracking and depth realization, overcoming key challenges for clinical application.
Area of Science:
- Neurosurgery
- Computer-Aided Surgery
- Medical Imaging
Background:
- Augmented reality (AR) is increasingly researched for clinical applications, driven by computing advancements.
- AR-based neuronavigation aims to enhance surgical precision and visualization during brain surgery.
Purpose of the Study:
- To develop novel object tracking and depth realization technologies for AR-based neuronavigation in brain surgery.
- To create a clinically applicable AR neuronavigation system overcoming current limitations.
Main Methods:
- Developed real-time inside-out tracking using visual inertial odometry and SLAM.
- Integrated cube QR markers and LiDAR depth data for continuous tracking.
- Implemented order-independent transparency, clipping, and annotation for depth realization.
Main Results:
- Confirmed stable AR model consistency with 3D printed patient models without flutter.
- Validated coordination accuracy with average movement errors of 0.34±0.21 mm (X-axis) and 0.04±0.08 mm (Y-axis).
- Enhanced perception of internal brain structures using advanced transparency techniques and depth aids.
Conclusions:
- The developed real-time tracking and depth realization technologies are effective.
- The METAMEDIP navigation system overcomes critical obstacles for clinical AR neuronavigation.
- Novel technologies enable continuous tracking and improved depth perception in AR surgical environments.

