Related Experiment Videos
EigenCodec: Ultra-low bitrate narrowband speech coding via eigen-informed subspace projection and multi-scale
Jingxiang Wang1,2, Ye Li1,2, Peng Zhang1,2
1Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan), Qilu University of Technology (Shandong Academy of Sciences), Jinan, China.
Abstract:
Narrowband speech coding at ultra-low bitrates remains challenging, primarily due to substantial information loss in highly compressed latent spaces and the computational constraints of lightweight edge models. In this paper, we propose EigenCodec, an efficient neural speech coding framework explicitly optimized for this regime. To enhance representation efficiency, we introduce the multi-scale depthwise aggregation block. By synergizing parallel depthwise convolutions with channel attention mechanisms and lightweight feed-forward networks, this module efficiently aggregates multi-resolution temporal dependencies, reducing parameter redundancy while maintaining receptive field density. Furthermore, addressing the information bottleneck, we propose an eigen-informed subspace projection strategy. By leveraging statistical priors from principal component analysis to initialize the quantization layers, we explicitly guide the encoder to map features into high-variance directions, thereby mitigating information loss during dimensionality reduction. Experimental evaluations on the 8 kHz-sampled LibriSpeech dataset show that EigenCodec yields a competitive balance between computational efficiency and reconstruction fidelity compared to existing baselines, delivering intelligible and natural-sounding narrowband speech reconstruction at 600 and 800 bps.
Related Concept Videos
Downsampling
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
Upsampling
Linear Approximation in Frequency Domain
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear.
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Bandpass Sampling
A bandpass signal has a spectrum with a lower frequency limit, denoted as ω1, and an upper frequency limit, denoted as ω2. The spectrum...
Reconstruction of Signal using Interpolation