Related Experiment Video
Updated: Jun 8, 2026
09:27
Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
Visual phonetic processing localized using speech and nonspeech face gestures in video and point-light displays.
Lynne E Bernstein1, Jintao Jiang, Dimitrios Pantazis
1Division of Communication and Auditory Neuroscience, House Ear Institute, Los Angeles, California, USA. lbernste@gwu.edu
Human Brain Mapping
|September 21, 2010
Summary
Researchers identified a specific brain region, the temporal visual speech area (TVSA), responsible for processing visual speech cues from talking faces. This area is distinct from other visual processing regions like the FFA and LOC.
Area of Science:
- Neuroscience
- Cognitive Science
- Visual Perception
Background:
- The human brain processes complex information from various sensory inputs.
- Visual speech cues from talking faces significantly contribute to speech comprehension.
- Identifying specific neural substrates for visual speech integration is crucial for understanding auditory-visual speech perception.
Purpose of the Study:
- To pinpoint the cortical areas involved in integrating linguistically relevant visual speech cues.
- To differentiate brain activation patterns for speech versus nonspeech facial gestures.
- To investigate the role of different visual display types (natural video, point-light) in visual speech processing.
Main Methods:
- Functional magnetic resonance imaging (fMRI) at 3.0T was employed.
- Participants viewed natural video and point-light displays of speech and nonspeech face gestures.
- Standard functional localizers for the fusiform face area (FFA), lateral occipital complex (LOC), and V5/MT were used.
Main Results:
- The FFA, LOC, and V5/MT showed reduced activation for speech compared to nonspeech stimuli.
- Distinct activation for speech, independent of display type, was observed in the posterior superior temporal sulcus and adjacent middle temporal gyrus.
- Individual analyses revealed speech activations were more anterior than nonspeech activations.
Conclusions:
- The identified speech-responsive area is proposed as the temporal visual speech area (TVSA).
- The study successfully localized the TVSA using a combination of visual speech stimuli and fMRI.
- This finding advances our understanding of the neural basis of audiovisual speech integration.
Related Concept Videos
01:24Prosopagnosia
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
01:21Association Areas of the Cortex
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
01:24Facial Feedback Hypothesis
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...
01:20Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...