Related Experiment Video
Updated: Jul 14, 2026

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex
Nienke M van Atteveldt1, Elia Formisano, Rainer Goebel
1University of Maastricht, Faculty of Psychology, Department of Cognitive Neuroscience, 6200 MD Maastricht, The Netherlands. N.vanAtteveldt@psychology.unimaas.nl
This study shows that the brain integrates letter and sound information automatically, enhancing auditory cortex responses. However, this integration disappears when actively matching stimuli, indicating task demands override automatic processing.
Area of Science:
- Neuroscience
- Cognitive Science
- Psycholinguistics
Background:
- The brain integrates visual letters and auditory speech sounds, crucial for reading.
- Previous research indicated letter-sound congruency affects auditory cortex activity, dependent on temporal synchrony.
Purpose of the Study:
- To differentiate multisensory integration from attention effects in letter-sound processing.
- To investigate how task demands influence neural integration of letter-sound pairs.
Main Methods:
- Event-related functional magnetic resonance imaging (fMRI).
- Randomized stimulus presentation to control for attention.
- Active matching task to manipulate top-down task demands.
Main Results:
- Replication of previous findings with random presentation, ruling out attention as the sole explanation.
- Absence of letter-sound congruency and synchrony effects in auditory cortex during active matching.
- Auditory cortex responses are modulated by learned letter-sound associations under passive viewing.
Conclusions:
- Auditory cortex processing of letter-sound pairs is influenced by learned associations and temporal synchrony.
- Multisensory integration in the auditory cortex is not automatic but depends on task relevance and attentional focus.
- Explicit task demands can override the natural tendency for audiovisual integration.
Related Concept Videos
Association Areas of the Cortex
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Auditory Pathway
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Motor and Sensory Areas of the Cortex
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
Somatosensory, Motor, and Association Cortex
Lateralization
Auditory Perception

