Related Experiment Video
Updated: Jan 12, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Mid-Level Audiovisual Crossmodal Correspondences: A Narrative Review
Charles Spence1, Nicola Di Stefano2
1Crossmodal Research Laboratory, Department of Experimental Psychology, Life and Mind Building, 1159University of Oxford, Oxford, OX1 3PS, UK.
Abstract:
This paper critically reviews the literature on mid-level audiovisual crossmodal correspondences, that is, those associations that emerge between structured, often dynamic stimuli in vision and audition. Unlike basic correspondences (involving perceptually simple, or unitary, features) or complex ones (involving semantically rich combinations of stimuli), mid-level correspondences occur between temporally and/or spatially patterned stimuli that are perceptually structured but are typically not inherently meaningful (e.g., melodic contours and moving shapes). Taken together, the literature published to date suggests that such correspondences often rely on structural or analogical mappings, reflecting shared spatiotemporal organization across the senses rather than the direct similarity of low-level features or emotional content. Drawing on evidence from developmental, comparative, and experimental studies, we discuss the possible mechanisms underpinning these mappings - including perceptual scaffolding, amodal dimensions, and metaphorical mediation - and outline open questions regarding their perceptual, cognitive, and neural bases. We also evaluate key methodological approaches and provide suggestions for future research aiming to understand the hierarchy of crossmodal correspondences across levels of perceived stimulus complexity. Besides advancing theoretical models, our paper offers practical insights for domains such as multimedia design and crossmodal art.
Related Concept Videos
Synesthesia
Sensory Modalities
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Causes of Similarity-Dissimilarity Effect
Channels of Non-Verbal Communication
Auditory Perception

