Speech Categorization Reveals the Role of Early-Stage Temporal-Coherence Processing in Auditory Scene Analysis

Area of Science:

• Auditory Neuroscience
• Computational Auditory Perception
• Speech Processing

Background:

• Temporal coherence of sound across spectral channels is vital for auditory grouping and scene segregation.
• Previous research on temporal coherence processing primarily focused on cortical areas, leaving the role of earlier auditory regions unexplored.
• Neurophysiological evidence suggests early auditory regions, like the cochlear nucleus, may initiate temporal-coherence-based scene analysis.

Purpose of the Study:

• To investigate if temporal-coherence processing in early auditory areas influences speech understanding in noisy environments.
• To test if physiologically plausible computational models can explain behavioral data on consonant categorization under masking.
• To determine if across-channel temporal-coherence processing improves predictions of speech perception errors (consonant confusions).

Main Methods:

• Conducted a behavioral experiment measuring consonant categorization in various masking conditions.
• Developed and tested computational models incorporating within-channel masking and across-channel temporal-coherence processing.
• Utilized consonant confusions as a detailed measure of speech categorization errors to rigorously test model predictions.

Main Results:

• Within-channel modulation masking alone could partially explain consonant confusions but failed when temporal fine structure cues were absent.
• The addition of across-channel temporal-coherence processing significantly enhanced the accuracy of confusion predictions across all tested conditions.
• Results indicate that temporal-coherence processing plays a substantial role in speech understanding in noise.

Conclusions:

• Across-channel temporal-coherence processing significantly contributes to auditory scene analysis and speech perception in noise.
• These findings suggest that computations supporting temporal-coherence processing may occur as early as the brainstem's auditory pathway.
• Consonant confusions offer a more detailed characterization of speech perception errors than intelligibility scores, providing deeper insights into auditory scene analysis mechanisms.