Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Optical imaging. Expansion microscopy.

Science (New York, N.Y.)·2015
Same author

Erratum for kang et Al., flexibility and symmetry of prokaryotic genome rearrangement reveal lineage-associated core-gene-defined genome organizational frameworks.

mBio·2015
Same author

Pretreatment with intravenous levetiracetam in the rhesus monkey Coriaria lactone-induced status epilepticus model.

Journal of the neurological sciences·2015
Same author

Apolipoprotein 4 may increase viral load and seizure frequency in mesial temporal lobe epilepsy patients with positive human herpes virus 6B.

Neuroscience letters·2015
Same author

[Analytical studies on flavonoids constituents in Apocynum venetom leaves by UPLC-Q-TOF-MS].

Zhong yao cai = Zhongyaocai = Journal of Chinese medicinal materials·2015
Same author

[Clinicopathological analysis of typical carcinoid primarily originated from middle ear, sphenoid and throat].

Zhonghua er bi yan hou tou jing wai ke za zhi = Chinese journal of otorhinolaryngology head and neck surgery·2015

Related Experiment Video

Updated: May 11, 2026

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

14.8K

Multi-Class Decoding of Attended Speaker Direction Using Electroencephalogram and Audio Spatial Spectrum.

Yuanming Zhang, Jing Lu, Fei Chen

    IEEE Transactions on Neural Systems and Rehabilitation Engineering : a Publication of the IEEE Engineering in Medicine and Biology Society
    |July 23, 2025
    PubMed
    Summary

    This study enhances auditory attention decoding by combining EEG with spatial audio information, improving the ability to identify a specific speaker's direction from multiple sources.

    More Related Videos

    Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding
    11:25

    Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding

    Published on: July 26, 2013

    43.5K
    A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
    11:14

    A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

    Published on: October 4, 2015

    11.1K

    Related Experiment Videos

    Last Updated: May 11, 2026

    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
    08:45

    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

    Published on: October 24, 2012

    14.8K
    Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding
    11:25

    Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding

    Published on: July 26, 2013

    43.5K
    A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
    11:14

    A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

    Published on: October 4, 2015

    11.1K

    Area of Science:

    • Neuroscience
    • Signal Processing
    • Machine Learning

    Background:

    • Selective Auditory Attention Decoding (sAAD) research has mainly focused on binary left-right tasks.
    • Decoding the precise direction of an attended speaker is crucial but challenging.
    • Existing methods often fail to fully utilize spatial audio cues, limiting performance.

    Purpose of the Study:

    • To improve directional focus decoding beyond binary tasks.
    • To leverage spatial audio information alongside EEG for enhanced sAAD.
    • To evaluate different model architectures and fusion strategies for multi-directional decoding.

    Main Methods:

    • Utilized a dataset with two concurrent speakers at 14 possible directions.
    • Integrated spatial spectra as an additional input to Electroencephalography (EEG) models.
    • Evaluated CNN, LSM-CNN, and Deformer architectures using all-in-one and pairwise decoding strategies.

    Main Results:

    • The proposed Sp-EEG-Deformer model achieved 14-class decoding accuracies of 55.35% (leave-one-subject-out) and 57.19% (leave-one-trial-out) with 1-second windows.
    • A pairwise Sp-EEG-Deformer decoder reached 63.62% accuracy with 10-second windows.
    • Spatial spectra effectively reduced the problem to binary classification, while EEG refined the final direction identification.

    Conclusions:

    • Integrating spatial spectra with EEG significantly enhances multi-directional auditory attention decoding.
    • The proposed dual-modal approach, particularly the Sp-EEG-Deformer, offers a promising solution for precise speaker localization.
    • This research advances sAAD capabilities for complex auditory environments.