The Benefit of a Visually Guided Beamformer in a Dynamic Speech Task

Area of Science:

• Audiology
• Acoustics
• Human-Computer Interaction

Background:

• Visually guided hearing aids (VGHAs) use eye gaze to direct highly directional microphones.
• Previous studies show VGHAs improve speech intelligibility for stationary sound sources.

Purpose of the Study:

• To assess VGHA performance in dynamic "real-world" communication scenarios.
• To determine if VGHA benefits persist when the target talker's location changes frequently.

Main Methods:

• 14 young adults (7 normal hearing, 7 hearing impaired) participated.
• Participants listened to target speech in competing conversations via headphones.
• A visually guided hearing aid (VGHA) steered a directional microphone array based on eye movements.
• Performance was compared between fixed and dynamic target locations.

Main Results:

• VGHA benefits were observed in the fixed condition compared to natural binaural listening.
• These benefits were reduced in the dynamic condition.
• Reduced performance in the dynamic condition was linked to less accurate visual fixation.

Conclusions:

• VGHA effectiveness may be limited in dynamic listening environments due to challenges with visual fixation.
• Further research is needed to optimize VGHA performance for real-world, changing conversational settings.