Related Experiment Video
Updated: Jun 21, 2026
09:44
Recording and Analyzing Multimodal Large-Scale Neuronal Ensemble Dynamics on CMOS-Integrated High-Density Microelectrode Array
Published on: March 8, 2024
Explicit encoding of multimodal percepts by single neurons in the human brain
Rodrigo Quian Quiroga1, Alexander Kraskov, Christof Koch
1Department of Engineering, University of Leicester, LE1 7RH Leicester, UK. rqqg1@le.ac.uk
Current Biology : CB
|July 28, 2009
Summary
The human brain can recognize the same person across different sensory inputs, like images, sounds, and text. Single neurons in the medial temporal lobe (MTL) show this multimodal invariance, forming percepts rapidly.
Area of Science:
- Neuroscience
- Cognitive Science
- Perception
Background:
- The brain recognizes individuals across varied visual stimuli (e.g., Warhol's portraits).
- The ventral pathway processes visual information, but cross-modal recognition remains unclear.
- Cortical areas selective to voices and visual word forms are known.
Purpose of the Study:
- Investigate how the brain integrates visual, auditory, and textual information to form a unique percept.
- Determine if single neurons in the human medial temporal lobe (MTL) exhibit multimodal invariance.
- Understand the hierarchical processing and rapid formation of such neuronal representations.
Main Methods:
- Presented participants with pictures, spoken names, and written names of individuals.
- Recorded single-neuron activity in the human medial temporal lobe (MTL).
- Analyzed neuronal responses for selectivity and invariance across sensory modalities.
Main Results:
- Single neurons in the human MTL selectively responded to the same individual across different sensory modalities (pictures, sound, text).
- Multimodal invariance increased along the hierarchical structure within the MTL.
- These invariant neuronal representations were formed rapidly, within 1-2 days.
Conclusions:
- Single neurons in the human MTL can encode percepts explicitly, selectively, and invariantly across sensory modalities.
- The MTL plays a crucial role in integrating cross-modal information to form stable representations of individuals.
- Perceptual representations can be established quickly, highlighting neural plasticity.
Related Concept Videos
01:20Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
01:19Encoding
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
01:24Vision
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
01:26Visual System
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
01:22Neurons as Communicators of the Brain
Neurons, the fundamental units of the brain and nervous system, function as the primary transmitters of information throughout the body. Their ability to communicate through electrical and chemical signals is vital for every bodily function, from regulating the heartbeat to processing complex thoughts. Each neuron has three main components: the cell body (soma), dendrites, and an axon, each specialized to facilitate swift and efficient neural communication.
Cell Body
The cell body, also known...
Cell Body
The cell body, also known...
01:23Somatosensory, Motor, and Association Cortex
The somatosensory cortex in the parietal lobes is crucial for interpreting sensory data such as touch, temperature, and proprioception. The somatosensory cortex, situated in the parietal lobes, plays a vital role in interpreting sensory information like touch, temperature, and proprioception—awareness of body position. This specialized brain region features an organized structure wherein neurons at the top primarily process sensations originating from the lower body. In contrast, those at the...