Hearing impairment and audiovisual speech integration ability: a case study report

Area of Science:

• Audiology
• Neuroscience
• Speech-Language Pathology

Background:

• Audiovisual speech perception relies on integrating auditory and visual cues.
• Sensory factors like acuity influence multisensory speech integration.
• Hearing impairment can affect the ability to combine speech information.

Purpose of the Study:

• To examine audiovisual speech integration in hearing-impaired listeners using a novel capacity measure.
• To investigate the role of reaction time and accuracy in multisensory speech processing.
• To determine if audiometric configuration predicts speed-accuracy tradeoffs in audiovisual integration.

Main Methods:

• A case study design was employed with hearing-impaired participants.
• A new capacity measure assessing reaction time and accuracy was utilized.
• Two experiments were conducted: open-set sentence recognition and closed-set speeded-word recognition.

Main Results:

• Capacity assessments revealed significant speed-accuracy tradeoffs in audiovisual speech integration.
• Some participants improved accuracy but not speed when combining auditory and visual cues.
• Other participants showed processing time benefits without accuracy gains.

Conclusions:

• Audiovisual speech integration capacity varies among hearing-impaired individuals.
• Speed-accuracy tradeoffs in multisensory speech perception are influenced by individual listener characteristics.
• The findings highlight the complexity of auditory-visual speech cue combination in hearing impairment.