In Situ Visualization for 3D Ultrasound-Guided Interventions with Augmented Reality Headset

Area of Science:

• Medical Imaging
• Surgical Technology
• Human-Computer Interaction

Background:

• Augmented Reality (AR) head-mounted displays (HMDs) offer hands-free visualization for complex manual tasks, particularly in surgery.
• Integrating AR with 3D ultrasound provides real-time, spatially registered information on unexposed soft tissues during procedures.

Purpose of the Study:

• To demonstrate the reliability of an AR-HMD system for guiding high-precision manual tasks.
• To assess the accuracy of an integrated AR and 3D ultrasound system in a simulated surgical environment.

Main Methods:

• An in vitro study simulated a biopsy intervention using an AR-HMD guided by a 3D ultrasound imaging system.
• Ten subjects performed biopsies on spherical lesions of decreasing sizes (10, 7, 5, and 3 mm).
• System accuracy was quantitatively measured.

Main Results:

• 80% of subjects successfully completed biopsies on a 5 mm lesion.
• The system achieved an accuracy of 2.5 mm.
• The AR guiding system proved effective for in-depth, high-precision tasks.

Conclusions:

• The integrated AR and 3D ultrasound system is reliable for navigating complex manual tasks in surgery.
• The system enhances intra-operative guidance by providing real-time information on subsurface anatomy.
• This technology shows promise for improving accuracy in image-guided interventions.