An ideal observer analysis of variability in visual-only speech

Area of Science:

• Auditory and Speech Science
• Human Perception
• Visual Communication

Background:

• Normal-hearing individuals possess lipreading skills, understanding speech visually without sound.
• Variability exists in lipreading ease among different speakers.
• Factors contributing to this variability include visual speech information and perceptual strategies.

Purpose of the Study:

• To investigate the sources of variability in lipreading ease among different talkers.
• To compare human performance with an ideal observer model in visual-only speech recognition.

Main Methods:

• Utilized a visual-only speech recognition task.
• Compared human lipreading performance against an ideal observer model.
• Analyzed the physical information produced during speech by different talkers.

Main Results:

• Talkers significantly vary in the amount of physical information they produce during speech.
• Human perceptual strategies are not uniform and contribute to talker variability in lipreading.
• Both talker-produced visual information and listener perception play roles in lipreading success.

Conclusions:

• Lipreading ease is influenced by both the visual characteristics of a speaker's speech and the listener's perceptual strategies.
• Understanding these factors can inform the development of improved speech perception aids.
• Further research is needed to fully elucidate the interplay between visual speech production and perception.