Supramodal representation of emotions

Area of Science:

• Neuroscience
• Social Cognition
• Affective Science

Background:

• Supramodal emotion representation is crucial for social cognition.
• Neural substrates for integrating facial and vocal emotions remain unclear.
• Existing research lacks clarity on whether integration occurs in sensory, multimodal, or affective brain regions.

Purpose of the Study:

• To investigate the neural basis of supramodal emotional information processing.
• To determine where perceptual integration of facial and vocal emotions occurs in the brain.
• To differentiate brain responses to congruent versus incongruent emotional audiovisual stimuli.

Main Methods:

• Utilized novel computer-generated stimuli pairing emotional faces and voices.
• Assessed functional brain activity using functional magnetic resonance imaging (fMRI).
• Employed an emotional classification task with congruent and incongruent audiovisual emotional stimuli.

Main Results:

• Both congruent and incongruent audiovisual stimuli increased activity in the thalamus and superior temporal regions compared to unimodal stimuli.
• Congruent emotions activated the amygdala, insula, ventral posterior cingulate (vPCC), temporo-occipital, and auditory cortices.
• Incongruent emotions engaged a frontoparietal network and bilateral caudate nucleus, suggesting higher cognitive load.
• The vPCC showed differential responses to congruency/incongruency across all emotion types.
• The left amygdala specifically responded to supramodal happy stimuli.

Conclusions:

• Emotional information integration does not occur at the initial perceptual audiovisual level.
• The ventral posterior cingulate (vPCC) acts as a central hub for supramodal representation of complex emotional information.
• The amygdala plays a role in the supramodal representation of specific emotions, such as happiness.
• Findings highlight the vPCC and amygdala as critical structures for audiovisual emotional integration, rather than primary or multimodal sensory areas.