Replicating outdoor environments using VR and ambisonics: a methodology for accurate audio-visual recording,...

Area of Science:

• Virtual Reality (VR)
• Acoustics
• Immersive Audio

Background:

• Virtual reality (VR) experiments require realistic audio-visual environments.
• Reproducing complex outdoor soundscapes in a lab setting presents significant challenges.

Purpose of the Study:

• To develop and evaluate a methodology for capturing, processing, and replicating 360° video and higher-order ambisonic (HOA) audio of outdoor environments for VR.
• To assess the impact of different ambisonic decoder orders on the perceived realism of reproduced soundscapes.

Main Methods:

• Utilized 360° video and HOA field recordings for outdoor environments.
• Implemented calibrated spatial sound reproduction using a spherical loudspeaker array and head-mounted display.
• Developed a graphical user interface for perceptual experimental questionnaires.
• Designed and evaluated four ambisonic decoders (one 2D first-order, three 3D third-order).

Main Results:

• Participants rated the realism of reproduced soundscapes.
• Third-order ambisonic decoders were consistently ranked as more realistic than the first-order decoder.
• The methodology enabled the replication of complex outdoor audio-visual data in a controlled lab environment.

Conclusions:

• The proposed methodology effectively captures and reproduces immersive outdoor audio-visual experiences for VR.
• Higher-order ambisonic decoders are crucial for achieving greater realism in spatial audio reproduction for VR applications.
• This research contributes to more immersive and perceptually valid VR experimental designs.