Related Experiment Video
Updated: Sep 30, 2025
10:25
Technical Approach for Infrared Tracking for Soft Tissue Navigation with a Holographic Head-Mounted Display and Preclinical Validation
Published on: September 2, 2025
84
Augmented reality navigation with real-time tracking for facial repair surgery
Long Shao1, Tianyu Fu2, Zhao Zheng1
1Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China.
Summary
This study introduces a novel noninvasive method for real-time patient tracking during facial repair surgeries (FRS). The system achieves high positioning accuracy without markers, improving surgical navigation.
Area of Science:
- Medical Imaging
- Surgical Navigation
- Computer Vision
Background:
- Facial repair surgeries (FRS) demand precise navigation of critical anatomy.
- Current methods may be invasive or lack real-time accuracy.
Purpose of the Study:
- To develop a noninvasive, real-time method for accurate patient tracking in FRS using single-camera video data.
- To enhance surgical accuracy and safety in FRS.
Main Methods:
- Camera calibration and computed tomography (CT) surface registration.
- A two-step constraint algorithm (feature local and distance standard deviation) for optimal feature matching.
- Decomposition of image motion matrix to track patient and camera movement.
Main Results:
- Achieved fusion error RMS of 1.44 ± 0.35 mm (skull phantom), 1.50 ± 0.15 mm (cadaver mandible), and 1.63 ± 0.03 mm (human experiments).
- Outperformed optical tracking system-based methods in accuracy.
- Processed video streams at 24 frames per second, meeting real-time requirements for FRS.
Conclusions:
- The markerless method ensures automatic maintenance of augmented reality scenes.
- Overcomes positioning accuracy degradation caused by patient movement during surgery.
- Offers a noninvasive, real-time, and highly accurate solution for FRS.
