Incongruence effects in crossmodal emotional integration

Area of Science:

• Neuroscience
• Cognitive Science
• Psychology

Background:

• Emotions are frequently perceived through multiple sensory inputs simultaneously.
• The interplay between different sensory modalities can influence emotional perception and create conflict.

Purpose of the Study:

• To investigate how auditory stimuli influence the perception of facial emotional expressions.
• To identify the neural correlates of emotional conflict arising from audiovisual incongruence.

Main Methods:

• Functional magnetic resonance imaging (fMRI) was used to collect whole-brain data from 35 healthy participants.
• Participants judged emotional facial expressions while exposed to congruent or incongruent emotional/neutral sounds.
• Behavioral responses and brain activation patterns were analyzed.

Main Results:

• Auditory screams intensified fear perception in fearful and neutral faces.
• Emotional incongruence between faces and sounds increased activation in the middle cingulate cortex, right superior frontal cortex, right supplementary motor area, and right temporoparietal junction.
• The amygdala showed heightened activation when both sensory inputs were emotional, but attenuated responses when one input was neutral.

Conclusions:

• Audiovisual emotional incongruence engages a cingulate-fronto-parietal network for conflict monitoring and resolution.
• Amygdala responses in audiovisual pairings may indicate the absence of neutral stimuli rather than solely the presence of emotional stimuli.