Related Experiment Videos
Effects of horizontal viewing angle on visual and audiovisual speech recognition
1School of Psychology, University of Nottingham, University Park, England. trj@psychology.nottingham.ac.uk
Summary
Visual speech recognition is robust to viewing angle changes when speech is audiovisual. However, identifying visual speech alone becomes less accurate at extreme angles, especially with distracting elements present.
Area of Science:
- Audiovisual perception
- Speech processing
- Human-computer interaction
Background:
- Viewing angle significantly impacts visual perception.
- Understanding how viewing angle affects speech recognition is crucial for real-world applications.
Purpose of the Study:
- To investigate the impact of horizontal viewing angle on visual and audiovisual speech recognition.
- To determine if explicit visual speech identification is affected differently than audiovisual speech processing.
Main Methods:
- Four experiments were conducted using a talker's face at full face, three-quarters, and profile views.
- Visual speech identification and audiovisual speech recognition were assessed under varying conditions, including the presence of distractor items.
Main Results:
- Visual speech identification decreased at profile views when distractor items were present.
- Audiovisual speech recognition (both congruent and incongruent) remained unaffected by viewing angle changes, even with distractors.
Conclusions:
- Audiovisual speech recognition is resilient to significant horizontal viewing angle variations.
- Explicit identification of visual speech is less robust and more susceptible to environmental factors like distractors.