Recalibration of vocal affect by a dynamic face

Area of Science:

• Auditory perception
• Visual perception
• Emotional processing

Background:

• Perception of vocal affect is known to be influenced by concurrent visual emotional cues.
• Previous research highlights the integration of auditory and visual information in emotional perception.

Purpose of the Study:

• To investigate whether visual emotional information can induce recalibration of vocal affect perception.
• To explore the mechanisms underlying audiovisual emotional perception, specifically error minimization and adaptation.

Main Methods:

• Participants were exposed to videos of emotional faces (happy or fearful) paired with sentences of ambiguous prosody.
• Auditory perception of ambiguous test sentences was assessed after exposure to congruent or incongruent audiovisual stimuli.
• The study manipulated audiovisual discrepancies to differentiate between recalibration and adaptation effects.

Main Results:

• Exposure to happy faces led to ambiguous vocal stimuli being perceived as happier, indicating recalibration.
• When audiovisual stimuli were congruent, aftereffects suggested adaptation rather than recalibration.
• These findings demonstrate a flexible recalibration of vocal affect perception influenced by visual emotional cues.

Conclusions:

• Visual emotional information can actively recalibrate the perception of vocal affect.
• The brain adjusts auditory perception to minimize inter-sensory discrepancies, a process demonstrated here for vocal emotion.
• This study provides the first evidence for recalibration of vocal affect perception by visual input.