Related Experiment Video
Updated: Jun 21, 2026

06:18
Pedicle Screw Placement Using an Augmented Reality Head-Mounted Display in a Porcine Model
Published on: May 24, 2024
Landmark-based augmented reality system for paranasal and transnasal endoscopic surgeries
Ramesh Thoranaghatte1, Jaime Garcia, Marco Caversaccio
1ARTORG Research Centre, University of Bern, Stauffacherstrasse 78, Bern, Switzerland. rameshtu@yahoo.com
Summary
This study introduces a novel landmark-based augmented reality (AR) endoscope system for endoscopic sinus surgery. The system accurately overlays surgical navigation data, aiding surgeons in orientation and navigation during procedures.
Area of Science:
- Medical Imaging
- Surgical Navigation
- Augmented Reality
Background:
- Endoscopic paranasal and transnasal surgeries require precise navigation.
- Current systems may lack real-time, integrated visual guidance.
- Augmented reality (AR) offers potential for enhanced surgical visualization.
Purpose of the Study:
- To present a novel landmark-based AR endoscope system for endoscopic sinus surgery.
- To introduce fast and automatic calibration and registration methods for the endoscope.
- To evaluate the system's accuracy in a controlled and cadaveric setting.
Main Methods:
- Surgeons select or define landmarks in preoperative CT scans.
- Landmarks are registered to the patient and overlaid onto the endoscopic video stream.
- Endoscope optics are calibrated and registered using fast, automatic procedures.
Main Results:
- The system achieved a Root Mean Square (RMS) error of 0.8 mm in a metallic grid setup.
- The RMS error was 2.25 mm during cadaver studies.
- Augmented landmarks, including name, color, and distance, are displayed.
Conclusions:
- A novel landmark-based AR endoscope system has been successfully implemented and validated.
- The system demonstrates capability for enhancing surgical orientation and navigation.
- Further clinical studies are planned to assess real-world surgical performance.

