Assessing variability in audiovisual speech integration skills using capacity and accuracy measures

Area of Science:

• Auditory Neuroscience
• Speech Perception
• Human Communication

Background:

• Face-to-face communication heavily relies on integrating auditory and visual speech information.
• This audiovisual integration is vital in challenging listening environments and for individuals with sensory or cognitive impairments.
• Older adults and hearing-impaired listeners particularly benefit from enhanced visual speech processing.

Purpose of the Study:

• To quantify audiovisual speech integration skills using a novel capacity measure assessing speed and accuracy.
• To explore the relationship between hearing thresholds (high and low frequency) and audiovisual integration capacity.
• To investigate how sentence recognition gain relates to audiovisual integration abilities.

Main Methods:

• Employed a within-subjects design for speech recognition experiments.
• Utilized an open-set sentence recognition task and a closed-set speeded-word classification task to measure integration capacity.
• Recruited 44 adult participants with no self-reported history of hearing loss.

Main Results:

• A significant correlation was found between measures of audiovisual integration and hearing thresholds.
• Audiovisual integration capacity was directly associated with participants' auditory sensory capabilities.
• The study identified a link between speech recognition gain and integration performance.

Conclusions:

• Listener's capacity to integrate auditory and visual speech cues is associated with their auditory sensory function.
• The findings suggest that auditory capabilities play a role in the speed and accuracy of audiovisual speech integration.
• Other sensory and cognitive factors may also influence an individual's ability to integrate speech information from multiple modalities.