Real-time in situ three-dimensional integral videography and surgical navigation using augmented reality: a pilot...

Area of Science:

• Oral and Maxillofacial Surgery
• Medical Imaging
• Augmented Reality Technology

Background:

• Preoperative imaging is crucial for oral and maxillofacial surgery.
• Accurate visualization of surgical sites and preoperative data is essential for successful outcomes.
• Existing navigation systems may have limitations in real-time 3D visualization.

Purpose of the Study:

• To assess the feasibility and precision of a novel 3D augmented reality (AR) system.
• To integrate integral videography with AR for oral and maxillofacial imaging.
• To evaluate the system's accuracy in overlaying preoperative computed tomography (CT) data onto the surgical field.

Main Methods:

• Created 3D surface models from CT data for integral videography.
• Developed an AR system comprising integral videography display, CT, position tracker, and computer.
• Performed feasibility study on a volunteer and accuracy verification on a solid model.
• Utilized positional registration for superimposing 3D images of jawbones, teeth, and surgical tools.

Main Results:

• The AR system successfully generated a 3D overlay projected onto the surgical site.
• Integral videography images were accurately superimposed with the surgical tool and patient anatomy.
• Accuracy verification on a solid model showed negligible positional differences (<1 mm).
• Surgeons could observe 3D images and the patient simultaneously without special glasses, regardless of viewing angle.

Conclusions:

• The 3D AR system incorporating integral videography is highly accurate and effective for surgical navigation.
• It enables precise overlay of 3D CT images onto the patient's surgical area.
• The system enhances the surgeon's understanding of the spatial relationship between preoperative plans and the actual surgical site.