Related Experiment Video
Updated: Apr 7, 2026

07:46
Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
Published on: August 9, 2024
1.3K
Augmented reality visualization of deformable tubular structures for surgical simulation
Vincenzo Ferrari1,2,3, Rosanna Maria Viglialoro1, Paola Nicoli1
1EndoCAS Center, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Italy.
Summary
This study introduces an augmented reality (AR) system for surgical training. The novel approach accurately visualizes deformable anatomy, improving surgical simulation by tracking real-time changes in virtual structures.
Area of Science:
- Medical Simulation
- Augmented Reality (AR)
- Surgical Training
Background:
- Augmented reality (AR) enhances surgical training by integrating physical and virtual simulation benefits.
- Current AR systems struggle to update virtual anatomy in response to physical deformations during procedures.
Purpose of the Study:
- To develop and validate a proof-of-concept AR system for visualizing hidden, deformable tubular structures in real-time.
- To improve the accuracy of virtual anatomy updates in response to physical manipulations during surgical simulations.
Main Methods:
- Utilized nitinol tubes with electromagnetic sensors for AR visualization of deformable tubular structures.
- Tested the system in vitro on sensorized hepatic arteries (cystic, left, right, proper).
- Simulated surgical scenarios where a surgeon deformed the tubular structures in 10 distinct positions.
Main Results:
- Achieved a mean misalignment of 0.35 mm, standard deviation of 0.22 mm, and maximum misalignment of 0.99 mm between virtual and real arteries.
- Demonstrated high accuracy in tracking and visualizing deformations of tubular anatomical structures.
Conclusions:
- The developed AR system demonstrates feasible alignment accuracy for advanced surgical simulations.
- This technology can serve as a valuable aid for identifying and isolating critical tubular structures during complex surgical procedures.

