Related Experiment Video
Updated: Feb 6, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
A common representation of time across visual and auditory modalities
Louise C Barne1, João R Sato1, Raphael Y de Camargo1
1Centro de Matemática, Computação e Cognição, Universidade Federal do ABC (UFABC), Rua Arcturus, 03. Bairro Jardim Antares, São Bernardo do Campo, CEP 09606-070 SP, Brazil.
The brain processes auditory and visual time intervals similarly, suggesting a common neural representation for temporal information across senses. This finding is crucial for understanding adaptive behavior.
Area of Science:
- Neuroscience
- Cognitive Science
- Psychology
Background:
- Accurate time perception is vital for adaptive behaviors in humans and animals.
- Understanding how the brain encodes temporal information across different sensory modalities remains a key question.
Purpose of the Study:
- To investigate the similarities and differences in the neural encoding of temporal intervals between auditory and visual stimuli.
- To determine if a common neural representation exists for time perception across sensory modalities.
Main Methods:
- Human participants reproduced auditory and visual temporal intervals (750-1500 ms).
- Behavioral performance was analyzed for accuracy and correlation between modalities.
- Scalp electroencephalography (EEG) data was analyzed using multivariate pattern analysis (MVPA).
- A classifier was trained to predict elapsed intervals from EEG data, testing cross-modal generalizability.
Main Results:
- Behavioral results showed higher accuracy for auditory intervals but a strong performance correlation between auditory and visual modalities.
- EEG analysis revealed similar neural activity patterns during the late periods of intervals, both within and across modalities.
- A classifier could predict the elapsed interval regardless of the training sensory modality, indicating shared neural representations.
Conclusions:
- Auditory and visual temporal interval processing share common neural representations, despite some modality-specific differences.
- The findings suggest a unified neural mechanism for time perception across sensory inputs.
- This research provides insights into the brain's fundamental ability to track time for behavior.
Related Concept Videos
Common Ion Effect
State Space Representation
Consider an RLC circuit, a...
Graphical Representation of Inequalities
Control Volume and System Representations
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...
Sensory Modalities
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Vector Representation of Complex Numbers
Consider a function defined as the product of the complex factors in the numerator divided by the product of the complex factors in the...

