Improved depth perception with three-dimensional auxiliary display and computer generated three-dimensional panoramic...

Area of Science:

• Medical Technology
• Surgical Robotics
• Human-Computer Interaction

Background:

• Endoscopic surgery presents challenges in depth perception and field-of-view compared to open surgery.
• The Da Vinci robot's current 3-D visualization is limited to the surgeon, hindering assistant collaboration.
• Shared visual perception is crucial for effective teamwork in minimally invasive procedures.

Purpose of the Study:

• To enhance shared perception for the entire surgical team by implementing live 3-D monitors across Da Vinci robot generations.
• To evaluate user experience and performance improvements associated with 3-D monitor integration.
• To explore computer-generated 3-D reconstructions for enhanced surgical overview and training.

Main Methods:

• Integrated live 3-D monitors with three Da Vinci robot generations for all surgical team members.
• Conducted a two-year user experience questionnaire with 31 participants.
• Performed a comparative timing experiment of a complex interaction task using 2-D versus 3-D monitors with 18 users.
• Assessed computer-generated 3-D reconstructions from endoscopic video recordings.

Main Results:

• 84% of users preferred 3-D monitors, and 100% reported improved spatial perception.
• Urologists noted quicker task completion, especially for delicate procedures, when assistants used 3-D monitors.
• Teamwork during a cooperative task was 40% faster with 3-D monitors.
• Computer-generated 3-D reconstructions provided valuable interactive panoramas but were susceptible to movement artifacts.

Conclusions:

• Widespread adoption of 3-D monitors in robot-assisted surgery significantly enhances spatial perception and collaborative efficiency for the entire surgical team.
• The study demonstrates a tangible improvement in task performance and teamwork speed, particularly for intricate surgical maneuvers.
• Computer-generated 3-D reconstructions show promise for surgical training and planning, despite current limitations.