Related Experiment Video
Updated: May 6, 2026
07:36
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
16.6K
A network analysis of audiovisual affective speech perception
H Jansma1, A Roebroeck2, T F Münte3
1Department of Neurology, University of Lübeck, Lübeck, Germany; Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands.
Neuroscience
|November 5, 2013
Summary
This study reveals how the brain integrates emotional facial expressions and voice tone. Findings show the fusiform gyrus communicates with the amygdala during audiovisual emotional processing.
Area of Science:
- Neuroscience
- Cognitive Science
- Psychology
Background:
- Audiovisual (AV) integration is crucial for processing emotional cues.
- Understanding the neural basis of affective AV integration is essential for comprehending social cognition.
Purpose of the Study:
- To investigate the neural systems underlying the integration of emotional facial expressions and vocal prosody.
- To map the causal interactions between brain regions involved in affective AV integration.
Main Methods:
- Functional magnetic resonance imaging (fMRI) was used to collect brain activity data.
- Univariate analysis identified regions activated by emotional versus neutral facial expressions.
- Random-effects Granger causality mapping (RFX-GCM) was applied to determine directional connectivity between identified regions.
Main Results:
- Univariate analysis revealed significant activation in the amygdala, fusiform gyrus, middle temporal gyrus/superior temporal sulcus, and inferior occipital gyrus for emotional expressions.
- RFX-GCM analysis, using the amygdala as a seed region, demonstrated connectivity with the right fusiform gyrus.
- Evidence suggests a directional flow of information from the fusiform gyrus to the amygdala during affective AV integration.
Conclusions:
- The findings propose a refined model of face perception and AV-affective integration.
- The study highlights the role of the amygdala and fusiform gyrus in processing integrated emotional audiovisual information.
Keywords:
AVBOLDEMOFOVGranger causalityIFGMTGNEURFX-GCMSTSVVOIamygdalaaudiovisualaudiovisual speechblood oxygen level dependentemotionemotionalfMRIfacial affect perceptionfield of viewfunctional magnetic resonanceinferior frontal gyrusmiddle temporal gyrusneutralrandom effects Granger causality mappingsuperior temporal sulcusvisualvolume of interestMore Related Videos
Related Concept Videos
01:17Auditory Perception
1.5K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.5K
01:29Non-Verbal Cues
784
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
784
01:29The Influence of Affect on Cognition
440
Positive affect significantly influences cognitive processes, including evaluation, memory, creativity, and social judgments. Compared to negative affect, positive emotional states promote more favorable interpretations of stimuli, cognitive flexibility, and heuristic processing. These effects highlight emotions' powerful role in shaping how individuals perceive, remember, and interact with the world.Influence on Evaluation and AttributionWhen individuals experience positive affect, they are...
440
01:25Factors Affecting Perception
3.3K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
3.3K
01:01Perception of Sound Waves
4.7K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.7K
01:29The Influence of Cognition on Affect
327
Cognition plays a pivotal role in shaping emotional experiences, as demonstrated by Schachter and Singer’s two-factor theory of emotion. According to this model, emotion arises from a combination of physiological arousal and cognitive interpretation. The body’s physiological response to stimuli is ambiguous and only gains emotional significance through cognitive labeling. For instance, an increased heart rate and adrenaline surge while standing near an attractive person may be...
327