Related Experiment Video
Updated: Jul 12, 2025

13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
20.0K
Modality-specific brain representations during automatic processing of face, voice and body expressions.
Maarten Vaessen1, Kiki Van der Heijden2, Beatrice de Gelder3
1Zuyd University of Applied Science, Maastricht, Netherlands.
Frontiers in Neuroscience
|October 23, 2023
Summary
Brain scans reveal that facial, bodily, and vocal emotion expressions are processed in distinct neural pathways, suggesting they trigger rapid, adaptive behaviors specific to their type and sensory origin.
Area of Science:
- Affective science
- Neuroscience
- Psychology
Background:
- Traditional views suggest emotions are represented abstractly in the brain, regardless of sensory input.
- This perspective seeks shared, abstract neural representations for emotions from faces, bodies, and voices.
- An alternative view proposes rapid, automatic responses to specific emotion signals, bypassing abstract concepts.
Purpose of the Study:
- To investigate whether emotion expressions from different modalities (face, body, voice) are processed through distinct or shared neural pathways.
- To test if emotion processing relies on abstract concepts or modality-specific representations for rapid behavioral responses.
- To explore the brain's organization of affective signals in response to naturalistic dynamic emotion expressions.
Main Methods:
- Functional magnetic resonance imaging (fMRI) was used to study brain activity.
- Participants viewed dynamic, naturalistic emotion expressions from faces, bodies, or voices.
- An unrelated target detection task in a different sensory modality was employed to ensure automatic emotion processing.
Main Results:
- Multivariate analyses revealed a brain organization of affective signals that is specific to stimulus category and sensory modality.
- Neural activity patterns differed significantly based on whether the emotion stimulus was a face, body, or voice.
- Findings indicate distinct neural processing for different emotion expression types.
Conclusions:
- Emotion expressions from face, body, and voice may have unique functional roles in triggering rapid adaptive behaviors.
- The brain organizes affective signals in a modality- and stimulus-specific manner.
- Future research should adopt a neuroethological approach, observing emotion expressions in naturalistic contexts.
More Related Videos
Related Concept Videos
Facial Feedback Hypothesis
168
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
168
Association Areas of the Cortex
5.4K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.4K
Introduction to Special Senses
5.8K
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive...
5.8K
Muscles for Facial Expressions
2.1K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
2.1K
Functional Brain Systems: Limbic System
2.9K
The limbic system, often called the "emotional brain," is a complex set of structures located deep within the brain. The intricate network of the limbic system supports a wide range of psychological functions, from emotional regulation to memory formation and sensory processing. This functional brain region encompasses specific parts of the diencephalon and the cerebrum, integrating the higher mental functions of the cerebral cortex with the primitive emotional responses of the deep brain...
2.9K
Parallel Processing
159
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
159

