Enhancing Light Fields through Ray-Space Stitching.

Area of Science:

• Computer Vision
• Computer Graphics
• Image Processing

Background:

• Light fields (LFs) offer photorealistic visualization but are limited by small angular range and spatial resolution.
• Limited LF capabilities restrict the scope of virtual navigation experiences.

Purpose of the Study:

• To enhance seamless virtual navigation by stitching multiple light fields.
• To overcome limitations in angular range and spatial resolution of individual LFs.

Main Methods:

• Developed a two-component technique: LF registration and LF stitching.
• Utilized the ray-space motion matrix (RSMM) with Plücker coordinates for pairwise ray-ray correspondences.
• Employed multi-resolution, high-dimensional graph-cut for robust LF stitching, addressing scene motion and undersampling.

Main Results:

• Successfully registered and stitched multiple LFs to create enhanced visualizations.
• Demonstrated the creation of LFs with extended horizontal/vertical fields-of-view.
• Showcased enhanced features including larger synthetic aperture, defocus blur, and parallax.

Conclusions:

• Seamless virtual navigation can be significantly improved by stitching multiple light fields.
• The proposed RSMM and graph-cut method effectively handles registration and stitching challenges.
• The technique enables LFs with superior visual properties for immersive virtual experiences.