Design and preliminary testing of a visually guided hearing aid

Area of Science:

• Audiology
• Biomedical Engineering
• Human-Computer Interaction

Background:

• Hearing aids aim to improve speech intelligibility in complex acoustic environments.
• Current hearing aid technology struggles to adapt dynamically to changing sound sources.
• Integrating visual cues offers a novel approach to enhance hearing aid performance.

Purpose of the Study:

• To describe a novel hearing aid design integrating eye-tracking technology.
• To evaluate the acoustical and perceptual performance of this visually guided hearing aid (VGHA).
• To assess the potential of gaze-direction for steering acoustic beams in hearing devices.

Main Methods:

• Developed a prototype visually guided hearing aid (VGHA) coupling an acoustic beam-forming microphone array with an eye-tracker mounted on eyeglasses.
• Utilized an interface to translate eye-tracker gaze direction into control signals for steering the acoustic beam.
• Conducted preliminary speech intelligibility tests using noise and speech maskers.

Main Results:

• The VGHA prototype demonstrated the ability to steer the acoustic beam based on the user's direction of gaze.
• Preliminary measurements indicated near-normal or better spatial release from masking.
• Speech intelligibility was significantly improved in the presence of competing sound sources.

Conclusions:

• The findings support the principle of using visual gaze direction to guide acoustic beam-forming in hearing aids.
• The visually guided hearing aid (VGHA) shows promise for enhancing speech understanding in challenging listening situations.
• Further development is needed to transition the laboratory prototype into a wearable hearing prosthesis.