Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hearing01:31

Hearing

51.9K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.9K
Auditory Pathway01:15

Auditory Pathway

5.3K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.3K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Investigating the Dynamic Relationship Between Anxiety and Spatial Memory Using Autonomous Ecological Momentary Assessment.

bioRxiv : the preprint server for biology·2026
Same author

Large Language Models Reveal the Neural Tracking of Linguistic Context in Attended and Unattended Multi-Talker Speech.

bioRxiv : the preprint server for biology·2026
Same author

Large language models reveal the neural tracking of linguistic context in attended and unattended multi-talker speech.

Imaging neuroscience (Cambridge, Mass.)·2026
Same author

Real-time brain-controlled selective hearing enhances speech perception in multi-talker environments.

Nature neuroscience·2026
Same author

From Selective Listening to Brain-Controlled Hearing: A Perspective on the Future of Auditory Technology.

Journal of the Association for Research in Otolaryngology : JARO·2026
Same author

During natural vision, semantic novelty modulates fixation-related processing in primate cortex.

bioRxiv : the preprint server for biology·2026

Related Experiment Video

Updated: Jun 13, 2025

A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.5K

Brain-Controlled Augmented Hearing for Spatially Moving Conversations in Multi-Talker Environments.

Vishal Choudhari1,2, Cong Han1,2, Stephan Bickel3,4

  • 1Department of Electrical Engineering, Columbia University, New York, NY, 10027, USA.

Advanced Science (Weinheim, Baden-Wurttemberg, Germany)
|September 9, 2024
PubMed
Summary

This study introduces an advanced brain-controlled hearing system for better speech understanding in noisy environments. It uses auditory attention decoding with moving talkers to improve hearing assistance for individuals with hearing loss.

Keywords:
auditory attention decodingbrain‐computer interfacesdeep learninghearing aidsintracranial electroencephalographypsychophysicsspeech separation

More Related Videos

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.4K
Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

14.6K

Related Experiment Videos

Last Updated: Jun 13, 2025

A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.5K
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.4K
Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

14.6K

Area of Science:

  • Neuroscience
  • Audiology
  • Signal Processing

Background:

  • Hearing loss significantly impacts speech comprehension in multi-talker environments.
  • Auditory attention decoding (AAD) uses neural signals to enhance attended speech.
  • Existing AAD research often uses simplified, stationary talker scenarios.

Purpose of the Study:

  • To develop and evaluate a realistic brain-controlled assistive hearing system for challenging acoustic environments.
  • To integrate auditory attention decoding with advanced speech separation techniques.
  • To improve speech intelligibility and conversation tracking for individuals with hearing loss.

Main Methods:

  • Collected invasive electroencephalography (iEEG) data from three neurosurgical patients.
  • Developed a system combining AAD with a binaural speaker-independent speech separation model.
  • Simulated a realistic scenario with multiple, continuously moving talkers in background noise.

Main Results:

  • The integrated system successfully unmixed talkers while preserving spatial information.
  • AAD accuracy was improved by incorporating talker trajectories from the separation model.
  • Subjective and objective evaluations confirmed enhanced speech intelligibility and conversation tracking.

Conclusions:

  • The proposed system demonstrates significant potential for real-world assistive hearing applications.
  • This approach effectively addresses the challenges of auditory attention in dynamic, noisy environments.
  • It represents a substantial advancement in adaptive hearing technologies for everyday auditory experiences.