Real-time rendering method and performance evaluation of composable 3D lenses for interactive VR.

Area of Science:

• Computer Graphics
• Human-Computer Interaction
• Virtual Reality

Background:

• 2D Magic Lenses are well-established, but their extension to 3D (volumetric lenses) presents significant geometric and semantic challenges.
• Composing multiple 3D lenses, especially handling intersections, was previously considered infeasible.
• Existing methods lack efficient solutions for managing and composing multiple interactive 3D lenses.

Purpose of the Study:

• To present and evaluate a new approach for real-time rendering of composable 3D volumetric lenses.
• To enable efficient composition and intersection handling of multiple 3D lenses.
• To support novel interactive interfaces in 3D environments.

Main Methods:

• Developed a 3D volumetric lens approach for polygonal scenes.
• Implemented a Composite Shader Factory for composing shader programs and rendering intersection regions.
• Utilized Boolean combinations of region tests in fragment shaders for handling lens geometry (convex and non-convex CSG volumes).
• Incorporated a Region Analyzer module and broad-phase culling for efficiency.

Main Results:

• Demonstrated real-time rendering of composable 3D lenses.
• Successfully handled the geometric and semantic complexity of intersecting 3D lenses.
• The approach is suitable for head-tracked VR environments due to non-view-dependent data structure generation, enabling caching and reuse.
• Addressed order effects for composed 3D lenses.

Conclusions:

• The proposed 3D volumetric lens approach offers an efficient solution for composing multiple lenses in real-time.
• This method facilitates new interactive 3D interfaces, such as hierarchical windows and direct manipulation shader development.
• The system effectively manages complex lens intersections and is optimized for performance in VR settings.