Related Experiment Video
Updated: Jun 5, 2026
07:36
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
How vision is shaped by language comprehension--top-down feedback based on low-spatial frequencies
Gerrit Hirschfeld1, Pienie Zwitserlood
1Institute for Psychology, University of Münster, Münster, Germany. gerrit.hirschfeld@uni-muenster.de
Brain Research
|January 4, 2011
Summary
Language comprehension influences visual processing. Top-down feedback, not passive suppression, explains how context affects vision, especially with low-spatial frequencies.
Area of Science:
- Cognitive Neuroscience
- Visual Perception
- Language Processing
Background:
- Embodied-language framework links language comprehension and visual processing.
- Debate exists on whether effects stem from passive repetition suppression or active top-down feedback.
Purpose of the Study:
- To investigate the role of top-down feedback versus passive repetition suppression in language-vision interactions.
- To test a model predicting diminished effects when low-spatial frequencies are removed from visual targets.
Main Methods:
- Sentence-picture verification task comparing low-pass and high-pass filtered images.
- Assessed match advantage between sentence-implied object shape and target picture.
Main Results:
- A significant match advantage was observed for targets containing low-spatial frequencies.
- Linguistic context effects disappeared when low-spatial frequencies were filtered out.
- Top-down feedback model better explains results than repetition suppression.
Conclusions:
- Top-down feedback, driven by prediction, is crucial for language-vision integration.
- This model accounts for previous findings on lateralization and color effects.
- Active feedback mechanisms are key to understanding how language influences visual processing.
Related Concept Videos
01:15Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
01:24Vision
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
01:10Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
01:26Visual System
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:20Anatomy of the Eyeball
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle layer, the vascular tunic,...