Related Experiment Video
Updated: Jun 7, 2026

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
Published on: April 22, 2015
Perception of intersensory synchrony in audiovisual speech: not that special
Jean Vroomen1, Jeroen J Stekelenburg
1Tilburg University, Department of Medical Psychology and Neuropsychology, P.O. Box 90153, 5000 LE Tilburg, The Netherlands. J.Vroomen@uvt.nl
Abstract:
Perception of intersensory temporal order is particularly difficult for (continuous) audiovisual speech, as perceivers may find it difficult to notice substantial timing differences between speech sounds and lip movements. Here we tested whether this occurs because audiovisual speech is strongly paired ("unity assumption"). Participants made temporal order judgments (TOJ) and simultaneity judgments (SJ) about sine-wave speech (SWS) replicas of pseudowords and the corresponding video of the face. Listeners in speech and non-speech mode were equally sensitive judging audiovisual temporal order. Yet, using the McGurk effect, we could demonstrate that the sound was more likely integrated with lipread speech if heard as speech than non-speech. Judging temporal order in audiovisual speech is thus unaffected by whether the auditory and visual streams are paired. Conceivably, previously found differences between speech and non-speech stimuli are not due to the putative "special" nature of speech, but rather reflect low-level stimulus differences.
Related Concept Videos
Auditory Perception
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Perception
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Extrasensory Perception
Precognition involves foreseeing future events, such as predicting an accident before it happens. An example of precognition could be someone dreaming about a specific event, like a car crash, which then occurs...
Synesthesia

