Study on augmented reality for robotic surgery bedside assistants

Area of Science:

• Surgical Technology
• Human-Computer Interaction
• Robotics

Background:

• Robotic surgery bedside assistants are crucial for intra-corporeal tasks.
• Current visualization methods may limit efficiency and accuracy.
• Augmented reality (AR) offers potential for enhanced surgical visualization.

Purpose of the Study:

• To evaluate the impact of 3D augmented reality (AR) headsets on robotic surgery bedside task performance.
• To compare AR visualization with traditional 2D/3D bedside monitors.
• To assess the effect of AR device resolution on task efficiency and accuracy.

Main Methods:

• Bedside assistants performed validated tasks in a mock abdominal cavity with a docked surgical robot.
• Tasks were executed using 2D/3D bedside monitors or a 3D AR headset.
• Performance metrics included task completion time and error rates; AR resolution was also varied.

Main Results:

• 3D AR significantly decreased time and errors for complex tasks like stapling and path following.
• High-resolution 3D AR improved task times compared to lower resolution (14s vs 23s).
• A physician assistant using 3D AR performed comparably to an attending surgeon using the same technology.

Conclusions:

• 3D augmented reality vision, particularly with high resolution, enhances the efficiency and accuracy of complex robotic surgery bedside tasks.
• AR technology can enable less experienced assistants to perform at a level similar to experienced surgeons.
• Further research with diverse tasks and assistant experience levels is warranted.