Practical utility of a head-mounted gaze-directed beamforming system

Area of Science:

• Audiology
• Human-Computer Interaction
• Signal Processing

Background:

• Assistive auditory devices aim to enhance signal-to-noise ratio but must adapt to user attention to avoid suppressing desired sounds.
• Errors in attention-following can lead to the suppression of target speech, hindering effective communication.

Purpose of the Study:

• To describe a method for measuring the practical benefit of attention-following speech enhancement.
• To demonstrate the benefit of gaze-directed beamforming compared to natural binaural hearing.

Main Methods:

• Participants viewed a video conference with target speakers and interfering voices.
• An eye tracker yoked a simulated beamformer to the participant's gaze direction.
• A control condition simulated unaided binaural hearing with all voices spatially distributed.

Main Results:

• Participants scored twice as high on comprehension questionnaires in the gaze-directed beamforming condition.
• Sentence-by-sentence intelligibility tests showed participants recognized twice as many words with beamforming.
• The results demonstrate a practical benefit for gaze-directed beamforming.

Conclusions:

• Gaze-directed beamforming offers significant practical advantages for hearing aid technology.
• This study illustrates a method for retrieving detailed intelligibility data from engaged listening tasks.