Visualization modality for augmented reality guidance of in-depth tumour enucleation procedures

Area of Science:

• Medical Technology
• Surgical Innovation
• Augmented Reality Applications

Background:

• Wearable augmented reality (AR) systems enhance ultrasound (US)-guided biopsies by improving accuracy and reducing procedure times.
• Existing AR applications focus on biopsies, with a need for advanced systems for more complex procedures.

Purpose of the Study:

• To present the first AR system designed for guiding in-depth tumor enucleation procedures under US guidance.
• To develop an innovative visualization modality for real-time surgical tool tracking and trajectory guidance.

Main Methods:

• Development of an AR system featuring a novel visualization modality with depth-sensing cutting trajectories.
• Real-time tracking of an electric scalpel and virtual-to-virtual alignment with the target trajectory.
• Accuracy assessment of the scalpel's tip position estimation.

Main Results:

• The AR system demonstrated high accuracy in estimating the scalpel's tip position (0.4 mm mean depth error, 1.34 mm mean radial error).
• A preliminary user study confirmed successful guidance of an in-depth tumor enucleation procedure.
• The system facilitated preservation of the safety margin around the lesion during surgery.

Conclusions:

• The developed AR system is effective for guiding in-depth tumor enucleation under ultrasound guidance.
• This technology represents a significant advancement in minimally invasive surgical procedures.
• The system's accuracy and successful application in a preliminary study highlight its potential to improve surgical outcomes.