Auditory-visual perception of speech with reduced optical clarity

Area of Science:

• Audiology
• Speech Perception
• Visual Perception

Background:

• Speech perception relies on both auditory and visual cues.
• Optical distortions can mimic acoustic masking, affecting visual speech information.
• Understanding the interplay between visual and acoustic speech cues is crucial for audiology.

Purpose of the Study:

• To investigate the effect of optical distortion on visual-only and auditory-visual (A-V) speech perception.
• To compare the impact of optical distortion with acoustic masking on speech intelligibility.
• To explore the potential of optical distortion as an auditory training method for hearing-impaired individuals.

Main Methods:

• Speech stimuli (words, sentences) were presented live to normal-hearing adults and hearing-impaired children.
• A sheet of Plexiglas was placed between the talker and lipreader, with varying distances to create optical distortion (blurring).
• Observers attempted to identify speech stimuli under different degrees of optical distortion.

Main Results:

• Visual-only lipreading scores dropped to chance level with increased optical distortion.
• Auditory-visual (A-V) speech perception scores decreased gradually as optical distortion increased.
• Under severe optical distortion, A-V scores plateaued, indicating reliance on auditory information alone.

Conclusions:

• Optical and acoustic cues for speech perception exhibit a reciprocal relationship.
• Optical distortion can be a valuable tool for auditory training, encouraging attention to acoustic cues in A-V perception.
• This research offers insights into speech perception mechanisms and potential therapeutic applications for hearing impairment.