Related Experiment Video
Updated: May 13, 2026
12:09
Stimulating the Lip Motor Cortex with Transcranial Magnetic Stimulation
Published on: June 14, 2014
Real-time brain-controlled selective hearing enhances speech perception in multi-talker environments.
Vishal Choudhari1,2, Maximilian Nentwich3,4, Sarah Johnson3,4
1Department of Electrical Engineering, Columbia University, New York, NY, USA.
Nature Neuroscience
|May 11, 2026
Summary
This study demonstrates a novel brain-controlled hearing system that enhances speech understanding in noisy environments. The auditory attention decoding (AAD) system dynamically amplifies desired speech, improving intelligibility and reducing listening effort for users.
Area of Science:
- Neuroscience
- Audiology
- Biomedical Engineering
Background:
- Speech comprehension in noise is challenging for many.
- Conventional hearing aids amplify all sounds, failing to isolate target speakers.
- Auditory attention decoding (AAD) shows promise but lacks real-time perceptual validation.
Purpose of the Study:
- To implement and validate a closed-loop auditory attention decoding system for real-time speech enhancement.
- To assess the perceptual benefits of a brain-controlled hearing system.
- To establish a performance benchmark for auditory brain-computer interfaces.
Main Methods:
- Utilized high-resolution intracranial electroencephalography (iEEG) in neurosurgical patients.
- Developed a closed-loop system to decode auditory attention from brain signals.
- Dynamically amplified the attended talker based on real-time AAD.
Main Results:
- The system achieved high decoding fidelity for dynamic talker amplification.
- Demonstrated significant improvements in speech intelligibility.
- Showed a reduction in listening effort and consistent user preference.
- Successfully tracked both instructed and self-initiated attention shifts.
Conclusions:
- Real-time, brain-controlled hearing systems can provide tangible perceptual benefits.
- This work validates AAD as a practical solution for personalized assistive hearing.
- Establishes a benchmark for future auditory brain-computer interface development.
