A Virtual Reality System for Improved Image-Based Planning of Complex Cardiac Procedures

Area of Science:

• Medical Imaging
• Virtual Reality in Medicine
• Cardiovascular Surgery

Background:

• Congenital heart disease (CHD) necessitates detailed understanding of complex 3D cardiac anatomy.
• Current 2D displays of 3D echocardiography limit comprehension of dynamic cardiac structures.
• Interacting with 3D data using 2D tools is challenging, restricting use to specialists.

Purpose of the Study:

• To introduce a virtual reality (VR) system for immersive surgery planning.
• To utilize dynamic 3D echocardiography data within the VR environment.
• To evaluate the VR system's utility for clinicians in understanding and communicating complex cardiac imaging.

Main Methods:

• Developed a VR system for immersive surgery planning.
• Integrated dynamic 3D echocardiography data for visualization.
• Implemented advanced VR interaction features: volume rendering, multiplanar reformatting, flow visualization, 3D cropping, haptic feedback, and multiuser capabilities.

Main Results:

• The VR system facilitates rapid prototyping of 3D cardiac visualizations.
• Clinicians (imaging and non-imaging) found the VR system beneficial.
• Improved understanding and communication of 3D echocardiography data were reported.

Conclusions:

• The VR system offers a promising tool for enhancing the understanding of 3D echocardiography in CHD.
• Immersive visualization and advanced interaction in VR can potentially improve congenital heart disease treatment planning and execution.