Related Experiment Video
Updated: Jun 17, 2026

Stimulating the Lip Motor Cortex with Transcranial Magnetic Stimulation
Published on: June 14, 2014
Do you see what you are hearing? Cross-modal effects of speech sounds on lipreading
1Department of Medical Psychology and Neuropsychology, Tilburg University, P.O. Box 90153, Warandelaan 2, 5000 LE Tilburg, The Netherlands.
Abstract:
It is well known that visual information derived from mouth movements (i.e., lipreading) can have profound effects on auditory speech identification (e.g. the McGurk-effect). Here we examined the reverse phenomenon, namely whether auditory speech affects lipreading. We report that speech sounds dubbed onto lipread speech affect immediate identification of lipread tokens. This effect likely reflects genuine cross-modal integration of sensory signals and not just a simple response bias because we also observed adaptive shifts in visual identification of the ambiguous lipread tokens after exposure to incongruent audiovisual adapter stimuli. Presumably, listeners had learned to label the lipread stimulus in accordance with the sound, thus demonstrating that the interaction between hearing and lipreading is genuinely bi-directional.
More Related Videos
Related Concept Videos
Auditory Perception
Non-Verbal Cues
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Hearing
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Synesthesia
