High-speed optical tracking and augmented reality platform for image-guided interventions

Area of Science:

• Medical Imaging and Visualization
• Surgical Technology
• Augmented Reality Applications

Background:

• Clinicians face challenges mentally registering preoperative imaging onto patients during procedures.
• Accurate visualization of subsurface targets and critical structures is crucial for safe and effective interventions.

Purpose of the Study:

• To develop an augmented reality (AR)-based tracking system for real-time 3D visualization of lesion targets.
• To improve the precision of interventional procedures by leveraging cross-sectional imaging data.
• To address the cognitive load on clinicians during complex surgical navigation.

Main Methods:

• Developed a customized high-speed, real-time optical tracking system integrated with a holographic display.
• Combined the tracking system with a computer workstation and graphical user interface for seamless operation.
• Validated the AR platform by measuring target registration errors (TRE) in laparoscopic and prostate biopsy procedures on phantoms.

Main Results:

• The integrated AR platform demonstrated effective real-time tracking and visualization.
• Average TRE was 4.17 ± 1.63 mm for laparoscopic procedures.
• Average TRE was 2.89 ± 0.84 mm for prostate biopsy procedures.

Conclusions:

• An AR platform with a high-speed optical tracking system was successfully developed for interventional procedures.
• The system shows significant potential for enhancing accuracy in prostate laparoscopic and biopsy procedures.
• The AR platform's capabilities can be extended to a wider range of interventional applications.