Related Experiment Video
Updated: Aug 9, 2026

13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
A Multitude of Neural Representations Behind Multisensory "Social Norm" Processing
Felipe Pegado1,2,3, Michelle H A Hendriks1,3, Steffie Amelynck1
1Department of Brain and Cognition, KU Leuven, Leuven, Belgium.
Frontiers in Human Neuroscience
|May 10, 2018
Summary
This study reveals how the brain integrates auditory and visual information for social decisions. It shows interconnected neural systems processing sensory input and abstract concepts simultaneously.
Area of Science:
- Neuroscience
- Cognitive Science
- Psychology
Background:
- Human cognition involves integrating multisensory information for complex tasks like social perception.
- Traditional neuroimaging often studies isolated sensory systems or processing levels.
- A comprehensive understanding requires examining simultaneous processing across multiple systems and levels.
Purpose of the Study:
- To investigate the neural basis of social decision-making by integrating auditory and visual information.
- To explore simultaneous low-level, high-level, and abstract cognitive processing using a novel neuroimaging approach.
- To map brain representations across different sensory systems and cognitive levels.
Main Methods:
- Utilized a neuroimaging paradigm to capture multiple brain representations concurrently.
- Employed multivoxel pattern analysis (MVPA) on functional magnetic resonance imaging (fMRI) data.
- Designed a task requiring social decisions based on auditory-visual congruency.
Main Results:
- Confirmed expected neural representations across visual, auditory, and higher-order cognitive systems.
- Revealed interconnectedness between brain regions within and across sensory systems.
- Observed significant neural information selectivity for task-irrelevant features, such as visual animacy.
Conclusions:
- The brain exhibits a complex functional architecture beyond simple hierarchical organization.
- Neural systems share information, indicating a more integrated processing network than previously understood.
- This approach offers new insights into the rich, co-activated brain representations underlying natural human cognition.
Related Concept Videos
Sensory Perception: Organization of the Somatosensory System
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
Impact of Social Context on Individuals
Social psychology examines how the real or imagined presence of others influences individuals' thoughts, feelings, and behaviors. A key concept in this field is the role of social context in shaping behavior. The same individual may act differently depending on the social setting, due to the varying expectations and norms associated with each environment. This context-dependent behavior illustrates the influence of social roles, which prescribe appropriate conduct in specific situations.Social...
Causes of Social Behavior II: Cognitive Processes
Cognitive processes affect social behavior by guiding how individuals perceive, interpret, and respond to social stimuli. These mental processes enable individuals to assess others' behaviors, attribute causes to their actions, and form expectations based on past experiences.Causes of Behavior and Social JudgmentsIndividuals determine the causes of others' behaviors by distinguishing between personal traits and external circumstances. For example, if a friend frequently arrives late, an...
Automatic Processing and Automatic Social Behavior
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
Introducing Social Perception
Perceiving others accurately is fundamental to effective communication and relationship-building. Social perception, a key concept in social psychology, refers to the cognitive processes through which individuals gather and interpret information about others to understand their actions, intentions, and motivations. This process extends beyond spoken words and overt behaviors, incorporating subtle nonverbal cues and contextual factors.Nonverbal Cues and Their SignificanceNonverbal cues play a...

