Related Experiment Videos
Perception of asynchronous and conflicting visual and auditory speech
D W Massaro1, M M Cohen, P M Smeele
1Department of Psychology, University of California, Santa Cruz 95064, USA.
The Journal of the Acoustical Society of America
|September 1, 1996
Summary
Perceivers naturally integrate auditory and visual speech, but this integration can be disrupted by differences in stimulus onset asynchrony (SOA). The temporal window for speech integration depends on the range of speech events.
Area of Science:
- Cognitive Science
- Auditory Perception
- Speech Processing
Background:
- Face-to-face speech perception involves integrating auditory and visual information.
- Stimulus onset asynchrony (SOA) may affect this integration process.
Purpose of the Study:
- To investigate how variations in stimulus onset asynchrony (SOA) impact the integration of auditory and visual speech information.
- To determine the temporal window of integration for speech perception.
Main Methods:
- Two experiments utilized synthetic visual and natural/synthetic auditory syllables (/ba/, /va/, [symbol: see text]a/, /da/).
- An expanded factorial design presented all auditory-visual syllable combinations and unimodal stimuli.
- The Fuzzy Logical Model of Perception (FLMP) quantified the degree of auditory-visual speech integration.
Main Results:
- Integration of auditory and visual speech was observed.
- Differences in stimulus onset asynchrony (SOA) were found to disrupt speech integration.
- The temporal window for integration appears to be influenced by the range of speech events presented.
Conclusions:
- Auditory-visual speech integration is sensitive to temporal discrepancies between auditory and visual stimuli.
- The findings contribute to understanding the temporal dynamics and constraints of the speech integration process.