Related Experiment Video
Updated: Jan 12, 2026
13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
20.4K
Mid-Level Audiovisual Crossmodal Correspondences: A Narrative Review
Charles Spence1, Nicola Di Stefano2
1Crossmodal Research Laboratory, Department of Experimental Psychology, Life and Mind Building, 1159University of Oxford, Oxford, OX1 3PS, UK.
Multisensory Research
|November 1, 2025
Summary
Mid-level audiovisual crossmodal correspondences link structured sensory inputs, like sound and visuals. These associations often stem from shared spatiotemporal patterns, not just simple features or meaning.
Area of Science:
- Cognitive Science
- Neuroscience
- Psychology
Background:
- Audiovisual crossmodal correspondences link sensory inputs.
- Mid-level correspondences involve structured, dynamic stimuli (e.g., sound patterns and moving shapes).
- These differ from basic (unitary features) and complex (semantic) correspondences.
Purpose of the Study:
- Critically review literature on mid-level audiovisual crossmodal correspondences.
- Explore mechanisms and bases (perceptual, cognitive, neural) of these associations.
- Evaluate methodologies and suggest future research directions.
Main Methods:
- Literature review of developmental, comparative, and experimental studies.
- Analysis of structural and analogical mappings in crossmodal perception.
- Discussion of theoretical models and empirical evidence.
Main Results:
- Mid-level correspondences often rely on shared spatiotemporal organization.
- Structural or analogical mappings are key, not low-level feature similarity or emotion.
- Mechanisms may involve perceptual scaffolding, amodal dimensions, or metaphorical mediation.
Conclusions:
- Mid-level audiovisual correspondences are driven by structural, not semantic, factors.
- Understanding these mappings advances theoretical models of crossmodal perception.
- Findings offer insights for multimedia design and crossmodal art.
Related Concept Videos
01:27Synesthesia
490
Synesthesia is a remarkable condition where stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. People with synesthesia experience a blending or crossing of their senses, such as sight and sound, leading to cross-modal sensations. In this condition, the stimulation of one sense, such as hearing a number or musical note, triggers an experience of another sense, like sensing a specific color, taste, or smell. People...
490
01:15Sensory Modalities
3.7K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
3.7K
01:26Causes of Similarity-Dissimilarity Effect
250
The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
250
01:28Channels of Non-Verbal Communication
322
Non-verbal communication plays a critical role in human interaction, influencing how individuals perceive emotions and psychological states. It operates through four primary channels: facial expressions, eye contact, body language, and touch. These non-verbal cues help convey meaning beyond spoken language and are often culturally influenced.Facial Expressions and Emotional RecognitionFacial expressions are among the most powerful and universal forms of non-verbal communication. Research has...
322
01:17Auditory Perception
1.0K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.0K