Related Experiment Video
Updated: Jul 11, 2026
11:28
Concurrent EEG and Functional MRI Recording and Integration Analysis for Dynamic Cortical Activity Imaging
Published on: June 30, 2018
A novel approach to study audiovisual integration in speech perception: localizer fMRI and sparse sampling
Gregor Rafael Szycik1, Peggy Tausche, Thomas F Münte
1Department of Neuropsychology, Otto von Guericke University, University of Magdeburg, Universitätsplatz 2, Gebäude 24, 39106 Magdeburg, Germany.
Brain Research
|September 21, 2007
Summary
Visual cues enhance speech comprehension in noise, indicating brain audiovisual integration. This study identified specific brain regions in the superior temporal sulcus involved in processing these multisensory speech signals.
Area of Science:
- Neuroscience
- Cognitive Science
- Auditory Perception
Background:
- Speech comprehension in noisy environments is challenging.
- Visual information, such as lip movements, significantly aids auditory speech perception.
- This suggests the brain employs an audiovisual integration mechanism for speech processing.
Purpose of the Study:
- To identify the specific brain areas involved in audiovisual speech integration.
- To investigate how audiovisual congruity and intelligibility interact within these brain regions.
Main Methods:
- A stepwise functional neuroimaging approach was used in healthy German-speaking subjects.
- A functional localizer session identified brain areas activated by auditory, visual, and audiovisual speech.
- A second session with slow-event-related imaging examined these areas under varying audiovisual congruity and intelligibility conditions.
Main Results:
- Two bilateral clusters in the posterior superior temporal sulcus were identified as key areas for audiovisual speech processing.
- These regions showed the greatest activity for incongruent speech stimuli with added noise, highlighting their role in integration.
- The findings underscore the importance of audiovisual congruity and intelligibility in speech comprehension.
Conclusions:
- The study successfully identified brain regions crucial for audiovisual speech integration using a novel stepwise neuroimaging approach.
- The findings demonstrate the brain's sophisticated mechanisms for combining auditory and visual speech information, particularly under challenging listening conditions.
- This research provides a finer analysis of audiovisual speech integration, advancing our understanding of auditory perception.
