Exploring frequency-domain feature modeling for head-related transfer functions magnitude upsampling
Related Experiment Videos
Xingyu Chen1, Hanwen Bi1, Fei Ma1
1Centre for Audio, Acoustics and Vibration, Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, New South Wales 2007, Australia.
Abstract:
Accurate upsampling of head-related transfer functions (HRTFs) from sparse measurements is crucial for personalized spatial audio rendering. Traditional interpolation methods, such as kernel-based weighting or basis function expansions, rely on measurements from a single subject and are limited by the spatial sampling theorem, resulting in significant performance degradation under sparse sampling. Recent learning-based methods alleviate this limitation by leveraging cross-subject information, yet most existing neural architectures primarily focus on modeling spatial relationships across directions, whereas spectral dependencies along the frequency dimension are often modeled implicitly or treated independently. However, HRTF magnitude responses exhibit strong local continuity and long-range structure in the frequency domain, which are not fully exploited. This work investigates frequency-domain feature modeling by examining how different architectural choices-ranging from per-frequency multilayer perceptrons to convolutional, dilated convolutional, and attention-based models-affect performance under varying sparsity levels, showing that explicit spectral modeling consistently improves reconstruction accuracy, particularly under severe sparsity. Motivated by this observation, a frequency-domain Conformer-based architecture is adopted to jointly capture local spectral continuity and long-range frequency correlations. Experimental results on the SONICOM and HUTUBS datasets demonstrate that the proposed method achieves state-of-the-art performance in terms of interaural level difference and log-spectral distortion.
Related Concept Videos
Upsampling
Aliasing
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original signal...
Downsampling
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
Scaling
Discrete Fourier Transform
Properties of Fourier Transform I
In radio broadcasting, multiple audio signals often need to be transmitted simultaneously. The Fourier...