Augmented reality visualization of automated path planning for percutaneous interventions: a phantom study

Insertion point identification is a major challenge for percutaneous interventions. Planning in 2D slice image data is time-consuming and inefficient. Automated path planning can help to overcome these challenges. However, the setup of the intervention room is difficult to consider. In addition, transferring the insertion point to the skin is often prone to error. Therefore, a visualization for an automated path planning was implemented.

A condition-based automated path planning was calculated with path length, distance to risk structures and insertion angle. The results were displayed on a phantom using projector-based augmented reality (AR) with an access point selection using the insertion needle. Two variants of the insertion visualization and three target displays were evaluated in a user study.

A visualization of insertion points with a representation of the path quality resulted in a choice of safer paths, compared with no insertion point display or no coding of the path quality. A representation of the target was preferred in the final survey, but did not perform better. A target display separate from the insertion point visualization reduced interferences between visualizations.

A projector-based AR visualization of automated path planning results supports insertion point identification for percutaneous interventions. A display of the path quality enables the choice of safe access paths especially for unexperienced users. Further research is needed to identify clinical benefits and applicability.