Related Experiment Video
Updated: Feb 8, 2026

Using Visual and Narrative Methods to Achieve Fair Process in Clinical Care
Published on: February 16, 2011
Listening beyond seeing: Event-related potentials to audiovisual processing in visual narrative
Mirella Manfredi1, Neil Cohn2, Mariana De Araújo Andreoli1
1Social and Cognitive Neuroscience Laboratory, Center for Biological Science and Health, Mackenzie Presbyterian University, São Paulo, Brazil.
This study shows that our brains process word and sound meanings differently, yet integrate them into a shared understanding. This suggests semantic memory uses both specialized and general brain networks.
Area of Science:
- Cognitive Neuroscience
- Psycholinguistics
- Neuroimaging
Background:
- Conceptual knowledge representation is debated: modality-specific vs. amodal systems.
- Understanding how different sensory inputs are integrated into semantic memory is crucial.
Purpose of the Study:
- Investigate auditory semantic processing within a visual context.
- Examine cross-modal semantic integration using event-related brain potentials (ERPs).
Main Methods:
- Cross-modal paradigm using visual narratives and auditory stimuli (words/sounds).
- Recorded ERPs to semantically congruent and incongruent auditory stimuli.
- Analyzed N400 effect and late frontal negativity.
Main Results:
- Both incongruent words and sounds elicited an N400 effect.
- N400 distribution differed: centro-parietal for words, frontal for sounds.
- A sustained late frontal negativity was observed, modality-insensitive.
Conclusions:
- Semantic memory involves a distributed network accessible across modalities.
- Evidence supports both modality-specific and amodal processing in semantic memory.
- The brain integrates sensory information into a unified semantic representation.
Related Concept Videos
Integration of Synaptic Events
Potential Energy
Chemical bonds that form attractive forces between atoms also contain potential energy, called chemical energy. When a chemical reaction...
Potential Energy
Schwarzschild Radius and Event Horizon
The minimum speed required to launch a projectile from the surface of an object to which it is gravitationally bound so that it eventually escapes the object’s gravitational field is called the escape velocity. The escape velocity is independent of the mass of the object. Merging the idea of escape...
Standard Electrode Potentials
Cell Potential and Free Energy
Thermodynamics is the branch of physics dealing with the relationship between heat and other forms of energy. In an electrochemical cell, chemical energy is converted into electrical energy.
Thus, a link can be predicted between cell potential, free energy change, and the equilibrium constant for the reaction. Cell potential can also be measured as the oxidant or the reducing strength, and similar acid-base strength measures are reflected in equilibrium...

