Augmented Reality With Cinematic Rendered 3-Dimensional Images From Volumetric Computed Tomography Data

Area of Science:

• Medical Imaging
• Computer-Aided Diagnosis
• Radiology

Background:

• Cinematic rendering (CR) is a novel 3D visualization technique for volumetric computed tomography (CT) data.
• CR produces photorealistic images with superior surface detail and shadowing compared to traditional methods like volume rendering.
• The increasing availability of virtual reality (VR) and augmented reality (AR) interfaces presents new opportunities for medical imaging.

Purpose of the Study:

• To present initial experiences with viewing and manipulating CR images using VR/AR headsets.
• To describe the software and user interface for CR image interaction in VR/AR.
• To illustrate the potential of combining CR with VR/AR technology for medical applications.

Main Methods:

• Utilized a VR/AR headset for immersive visualization of CR-generated medical images.
• Explored the software and user interface designed for manipulating these 3D visualizations.
• Documented the process with pictorial examples for potential adopters.

Main Results:

• Demonstrated the feasibility of viewing and interacting with photorealistic CR images in a VR/AR environment.
• Highlighted the enhanced surface detail and realistic shadowing offered by CR.
• Provided insights into the user interface and initial steps for adopting this technology.

Conclusions:

• The convergence of CR and VR/AR technology holds significant potential for medical practice.
• Real-time, collaborative visualization of patient pathology could enhance communication between radiologists, surgeons, and referring providers.
• Further clinical trials are necessary to evaluate the added value and impact of CR combined with VR/AR.