Related Experiment Video
Updated: Jun 10, 2026
13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Do sensory cortices process more than one sensory modality during perceptual judgments?
Luis Lemus1, Adrián Hernández, Rogelio Luna
1Instituto de Fisiología Celular-Neurociencias, Universidad Nacional Autónoma de México, México, D.F., Mexico.
Neuron
|July 31, 2010
Summary
Sensory cortices show multimodal responses, but these do not aid perceptual judgments. Multimodal processing and decision-making occur outside these brain regions, challenging traditional sensory processing concepts.
Area of Science:
- Neuroscience
- Sensory processing
- Auditory and somatosensory cortices
Background:
- Traditional view: sensory cortices process single modalities.
- Emerging evidence: sensory cortices process multiple modalities.
- Unclear: identity of multimodal responses and their role in perception.
Purpose of the Study:
- Investigate multimodal responses in sensory cortices.
- Determine if these responses contribute to perceptual judgments.
- Identify the brain regions involved in cross-modal perception.
Main Methods:
- Recorded single-neuron activity in somatosensory and auditory cortices of monkeys.
- Used tactile and acoustic flutter stimuli for discrimination tasks.
- Designed tasks to assess unimodal and multimodal sensory processing.
Main Results:
- Neurons in sensory cortices responded to non-principal sensory modalities.
- Stimulus identity was decodable only from principal modality responses.
- Multimodal responses did not contribute to stimulus discrimination.
Conclusions:
- Multimodal encoding occurs in sensory cortices.
- Perceptual judgments rely on processing outside these areas.
- Challenges the strict sensory modality segregation model.
Related Concept Videos
01:14Motor and Sensory Areas of the Cortex
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
01:11Sensory Perception: Organization of the Somatosensory System
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
01:20Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
01:15Sensory Modalities
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
01:23Somatosensory, Motor, and Association Cortex
The somatosensory cortex in the parietal lobes is crucial for interpreting sensory data such as touch, temperature, and proprioception. The somatosensory cortex, situated in the parietal lobes, plays a vital role in interpreting sensory information like touch, temperature, and proprioception—awareness of body position. This specialized brain region features an organized structure wherein neurons at the top primarily process sensations originating from the lower body. In contrast, those at the...
01:26Introduction to Special Senses
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive functions.