Efficient HRTF-based Spatial Audio for Area and Volumetric Sources.

Area of Science:

• Virtual Reality Audio
• Spatial Audio Rendering
• Acoustics

Background:

• Traditional spatial audio often uses point-sampling for sound sources, which can be inefficient for complex sources in VR.
• Representing sound sources as areas or volumes offers a more realistic approach but poses computational challenges.

Purpose of the Study:

• To develop an efficient spatial audio rendering technique for area-volumetric sound sources in virtual reality (VR).
• To improve computational performance and memory efficiency compared to point-sampling methods.
• To enhance the subjective user experience in complex VR environments.

Main Methods:

• Projecting area-volumetric sound sources onto the spherical domain centered at the listener.
• Representing the projected source using spherical harmonic (SH) basis functions.
• Computing spatial audio via a dot product of SH coefficients of the source and the head-related transfer function (HRTF) represented in the same basis.

Main Results:

• Achieved computational complexity and memory requirements independent of sound source complexity.
• Enabled dynamic area-volumetric sound sources at interactive rates.
• Demonstrated significant performance improvements over naive point-sampling in large, complex VR environments.

Conclusions:

• The proposed SH-based technique offers an efficient and effective solution for rendering area-volumetric sound in VR.
• User evaluations indicate a subjective preference for the new approach over traditional point-sampling.
• This method enhances realism and immersion in VR audio experiences.