Related Experiment Video
Updated: Jun 24, 2026

Infant Auditory Processing and Event-related Brain Oscillations
Published on: July 1, 2015
Dynamic neural oscillations underpin audiovisual gain from visual lip cues in speech noise
Yanru Bai1, Shihong Jiang2, Jinghan Yang2
1Academy of Medical Engineering and Translational Medicine, Tianjin University, China; Xinjiang Hetian College, Xinjiang, China; Haihe Laboratory of Brain -Computer Interaction and Human-Machine Integration, China.
Abstract:
Speech noise substantially impairs speech perception, whereas congruent lip movements provide effective visual support when auditory input is degraded. Using natural continuous Mandarin sentences, the present study recorded behavioral and electroencephalographic (EEG) data under speech noise conditions with different signal-to-noise ratios (SNR) to examine the dynamic neural mechanisms by which visual lip information facilitates speech perception. The results showed that speech noise significantly reduced speech recognition accuracy and weakened δ band activity and functional connectivity in the superior temporal sulcus/posterior superior temporal gyrus (STS/pSTG) and auditory-related regions. Congruent lip movements significantly improved speech recognition in noise and enhanced δ/θ band activity in the STS/pSTG during the early stage after target speech onset. Further analyses showed that, under low-SNR conditions, congruent lip movements increased 11∼15 Hz functional connectivity between the STS/pSTG and motor-related regions. These findings suggest that visual lip information may first facilitate early audiovisual integration by modulating low-frequency neural oscillations and may further recruit sensorimotor networks under difficult listening conditions to provide compensatory support for speech perception in noise.
Related Concept Videos
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Neural Regulation
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Auditory Perception
Hearing
The Cochlea

