An interface for precise and comfortable 3D work with volumetric medical datasets

Area of Science:

• Computer-assisted surgery
• Human-computer interaction
• Neurosurgical technology

Background:

• Current 3D interaction methods often lack precision.
• Widget interaction in virtual environments can be ambiguous.
• Neurosurgical planning requires accurate manipulation of complex volumetric data.

Purpose of the Study:

• To develop and evaluate a novel 3D/2D interaction paradigm.
• To combine precise 3D volumetric data manipulation with unambiguous 2D widget interaction.
• To enhance neurosurgical planning applications.

Main Methods:

• Developed a 3D/2D interaction paradigm using armrests and wrist pivoting for precise 3D control.
• Implemented passive haptic feedback via a virtual control panel for unambiguous 2D interaction.
• Integrated the interface into a neurosurgical planning application.

Main Results:

• The interface enables precise manipulation of 3D volumetric data.
• Passive haptic feedback ensures unambiguous 2D widget interaction.
• The system was successfully tested in 17 clinical skull-base neurosurgical planning cases.

Conclusions:

• The developed 3D/2D interaction paradigm effectively combines precise 3D and unambiguous 2D interaction.
• The interface shows significant potential for improving neurosurgical planning applications.
• Clinical validation demonstrates the system's real-world applicability and effectiveness.