Related Experiment Video
Updated: Sep 6, 2025

07:46
Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
Published on: August 9, 2024
842
Augmented reality visualization of automated path planning for percutaneous interventions: a phantom study.
Lovis Schwenderling1, Florian Heinrich1, Christian Hansen2
1Faculty of Computer Science and Research Campus STIMULATE, University of Magdeburg, Magdeburg, Germany.
Summary
Automated path planning with augmented reality (AR) visualization improves insertion point identification for percutaneous interventions. Displaying path quality helps users select safer access routes, especially for those new to the procedure.
Area of Science:
- Medical imaging and intervention
- Augmented reality in medicine
- Surgical planning
Background:
- Percutaneous interventions require precise insertion point identification, a process often hindered by time-consuming 2D planning and potential errors in transferring planned paths to the patient.
- Current methods for planning percutaneous interventions using 2D image data are inefficient and do not adequately account for the intervention room setup or the transfer of the planned insertion point to the skin.
Purpose of the Study:
- To implement and evaluate a visualization system for automated path planning to address challenges in percutaneous interventions.
- To improve the accuracy and efficiency of insertion point identification and path selection during percutaneous procedures.
Main Methods:
- Automated path planning was performed considering path length, proximity to risk structures, and insertion angle.
- Projector-based augmented reality (AR) was used to visualize the planned paths on a phantom, with access point selection guided by an insertion needle.
- A user study evaluated two insertion visualization variants and three target display methods.
Main Results:
- Visualizing insertion points with path quality coding led to the selection of safer paths compared to un-coded displays.
- While a separate target display was preferred by users, it did not improve performance; however, it reduced visualization interference.
- Path quality visualization was particularly beneficial for less experienced users in selecting safer access paths.
Conclusions:
- Projector-based AR visualization of automated path planning results effectively aids insertion point identification in percutaneous interventions.
- Path quality display enhances the selection of safe access paths, particularly benefiting inexperienced users.
- Further investigation is required to establish the clinical benefits and applicability of this AR visualization system.

