Speech-reading of synthetic and natural faces: effects of contextual cueing and mode of presentation
Related Experiment Video
Updated: Aug 15, 2026

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
B Lidestam1, B Lyxell, M Lundeberg
1Department of Behavioural Sciences, Linköping University, Sweden. bjli@ipp.liu.se
Abstract:
A natural and a synthetic face were compared with regard to speech-reading performance, with a visual and an audio-visual condition, and with three levels of contextual cueing in an experiment with 90 normal-hearing subjects. Auditory presentation (speech in noise) served as a control condition. The results showed main effects for type of face, presentation mode and contextual cueing, and also an interaction between presentation mode and type of face, such that performance was superior for the natural compared with the synthetic face, and especially in the audio-visual mode. Audio-visual speech-reading was more accurate than visual and auditory presentation and contextual cueing improved performance overall. It is suggested that a synthetic face can be a valuable and useful support if proper cueing and an auditory signal are provided, but it is outperformed by a natural face with regard to complementarity to an underspecified auditory speech signal.
More Related Videos
09:09Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
Published on: September 27, 2024
05:48Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
Published on: August 9, 2024
Related Concept Videos
Framing Effects
Nonconscious Mimicry
Facial Feedback Hypothesis
Processes of Self-Presentation
Impression Management Techniques IV: Altercasting
Non-Verbal Cues