Important Modulation Frequency Components of Temporal Amplitude Envelope Contributing to Vocal Emotion Perception

Area of Science:

• Auditory Neuroscience
• Speech Processing
• Psychology

Background:

• The temporal amplitude envelope (TAE) of speech is significant for vocal emotion perception.
• Modulation processing is critical for understanding TAE in speech perception.
• Previous research highlighted the role of TAE modulation components, but key elements remain unidentified.

Purpose of the Study:

• To identify the specific modulation frequency components of TAE critical for vocal emotion perception.
• To clarify the contribution of different modulation frequencies to recognizing emotions in speech.

Main Methods:

• Experiments used noise-vocoded speech (NVS) with Japanese speakers.
• A modulation filterbank (MFB) simulated auditory modulation perception.
• TAE modulation components were filtered (bandpass/bandstop) to assess their impact on emotion recognition rates.

Main Results:

• Modulation filterbank (MFB) use did not significantly alter emotion perception in NVS.
• Modulation frequency components within the 0-16 Hz band were identified as important for both individual and collective emotion recognition.
• Potential subtle differences in important components between positive and negative emotions were noted but require further investigation.

Conclusions:

• The study identified the 0-16 Hz modulation frequency band as crucial for vocal emotion perception.
• These findings contribute to understanding the acoustic cues underlying emotional prosody.