Related Experiment Video
Updated: Dec 23, 2025

07:46
Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
Published on: August 9, 2024
1.1K
Video-based augmented reality combining CT-scan and instrument position data to microscope view in middle ear surgery
Raabid Hussain1, Alain Lalande2,3, Roberto Marroquin2
1ImViA Laboratory, University of Burgundy Franche Comte, Dijon, France. raabid.hussain@u-bourgogne.fr.
Scientific Reports
|April 23, 2020
Summary
This study developed an augmented reality system for keyhole ear surgery. The system accurately guides surgical instruments, achieving submillimetric precision for improved middle ear procedures.
Area of Science:
- Medical Technology
- Surgical Navigation
- Augmented Reality
Background:
- Keyhole middle ear surgery requires high precision.
- Current navigation systems may have limitations in accuracy and real-time feedback.
Purpose of the Study:
- To develop and evaluate a video-based augmented reality system for keyhole middle ear procedures.
- To combine preoperative computed tomography (CT) scans with real-time microscopic video for enhanced surgical guidance.
Main Methods:
- A system was developed integrating CT scans and microscopic video using fiducial markers for registration.
- Virtual endoscopy and microscope movements were tracked using Speeded-Up Robust Features (SURF).
- A Kalman filter tracked the micro-surgical instrument, determining its 3D position.
Main Results:
- Achieved an average initial registration accuracy of 0.21 ± 0.10 mm.
- Reported a surgical instrument tip position error of 0.33 ± 0.22 mm.
- Demonstrated target structure localization accuracy of 0.52 ± 0.15 mm.
Conclusions:
- The developed augmented reality system achieves submillimetric accuracy, suitable for ear surgery.
- This technology represents a crucial step towards safer and more precise keyhole middle ear interventions.

