A Rendering Engine for Integral Imaging in Augmented Reality Guided Surgery.

Area of Science:

• Medical Imaging
• Computer Science
• Human-Computer Interaction

Background:

• Augmented Reality (AR) wearable displays enhance surgical navigation by overlaying virtual information onto the real world.
• Optical see-through (OST) displays maintain real-world visual perception but suffer from vergence-accommodation conflict and calibration errors.
• Integral imaging displays offer a potential solution to overcome limitations in current AR systems.

Purpose of the Study:

• To develop and present a straightforward, real-time rendering strategy for integral imaging displays in AR surgical navigation.
• To address the vergence-accommodation conflict and calibration inaccuracies inherent in OST displays.
• To enhance the comfort and accuracy of AR-guided surgical procedures.

Main Methods:

• Implementation of a real-time rendering strategy using modern OpenGL.
• Integration of an integral imaging approach for displaying 3D virtual objects on wearable OST displays.
• Focus on achieving geometric consistency between real and virtual elements.

Main Results:

• A novel and easy real-time rendering strategy for integral imaging AR displays was successfully implemented.
• The proposed method facilitates the display of 3D virtual objects on wearable OST devices.
• The strategy aims to mitigate issues associated with vergence-accommodation conflict and calibration.

Conclusions:

• The developed rendering algorithm paves the way for improved AR surgical navigation.
• Enhanced comfort and accuracy in the AR experience are key benefits of this approach.
• This work contributes to the advancement of effective AR solutions in clinical settings.