Related Experiment Video
Updated: Mar 17, 2026

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
Published on: October 3, 2018
Neural systems involved in processing novel linguistic constructions and their visual referents.
Matthew A Johnson1, Nicholas B Turk-Browne1, Adele E Goldberg1
1Department of Psychology, Princeton University, Peretsman-Scully Hall, Princeton, NJ, 08540.
Learners use novel language constructions to predict visual scenes. Brain activity in the ventral striatum and occipital cortex shows how new phrases guide visual expectations and learning.
Area of Science:
- Psycholinguistics
- Cognitive Neuroscience
- Neuroimaging
Background:
- Abstract phrasal patterns in language convey meaning.
- The predictive role of novel linguistic constructions for visual scenes is not well understood.
Purpose of the Study:
- To investigate if and how novel linguistic constructions are used to predict upcoming visual scenes.
- To explore the neural mechanisms underlying prediction generation during language comprehension.
Main Methods:
- Two functional magnetic resonance imaging (fMRI) studies were conducted.
- Researchers examined brain activity, particularly in the ventral striatum and occipital cortex, in relation to comprehension of novel constructions and visual scene prediction.
Main Results:
- Increased ventral striatum activity correlated with poorer comprehension of novel constructions, suggesting a role in prediction error signaling.
- Attenuated occipital cortex activity indicated successful prediction of visual events based on learned constructions.
- These neural effects diminished when linguistic constructions offered no predictive information about visual events.
Conclusions:
- Initial exposure to novel linguistic constructions enables their semantics to be used for visual predictions.
- The brain evaluates predictions about new instances during the comprehension of novel language.
- Findings support predictive coding mechanisms in language comprehension and learning.
More Related Videos
05:35Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization
Published on: April 19, 2017
09:27Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
Related Concept Videos
Visual System
Once through the pupil, the light passes through the lens, a...
Higher Mental Functions of the Brain: Language
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Motor and Sensory Areas of the Cortex
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
Parallel Processing
Vision
Association Areas of the Cortex
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...