Related Experiment Video
Updated: Apr 1, 2026

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
Synaesthetic interactions across vision and audition.
Alexandra Krugliak1, Uta Noppeney1
1Centre for Computational Neuroscience and Cognitive Robotics, University of Birmingham, Edgbaston B15 2TT, Birmingham, UK, England.
This study reveals a surprising pitch-size association: small visual objects pair with low pitch, and large objects with high pitch. This finding challenges previous research on multisensory binding.
Area of Science:
- Cognitive Psychology
- Neuroscience
- Sensory Perception
Background:
- The brain integrates sensory signals for coherent perception.
- Synaesthetic correspondences, like pitch-sound and size-visual, influence multisensory binding.
- Previous research linked high pitch with small objects in static contexts, but recent studies show rising pitch with increasing size.
Purpose of the Study:
- To investigate the synaesthetic correspondence between auditory pitch and visual size.
- To determine if a pitch-size mapping exists in static visual contexts.
- To explore factors influencing pitch-size associations in multisensory perception.
Main Methods:
- An intersensory selective attention paradigm was employed.
- Participants fixated a central cross while discriminating visual size (small/large) or auditory pitch (high/low).
- Five experiments utilized pure tones and visual circles/discs of varying sizes.
Main Results:
- Consistent evidence showed participants associated small visual size with low pitch.
- Participants also associated large visual size with high pitch.
- This pitch-size mapping, typically seen in dynamic contexts, was observed in static conditions.
Conclusions:
- The study identified a novel pitch-size mapping in static visual contexts.
- This association may stem from interpreting visual size as an indicator of object distance or motion.
- Pitch-size mapping appears influenced by both relative and absolute stimulus levels.
More Related Videos
09:13Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
Published on: April 22, 2015
11:39Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
Related Concept Videos
Synesthesia
Auditory Perception
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
Hearing
Sensory Modalities
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...