Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Auditory Perception

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...

Perceiving Loudness, Pitch, and Location

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

High systolic blood pressure and stroke: evidence from the NHANES 1999-2023 and global burden of disease 2021.

Experimental biology and medicine (Maywood, N.J.)·2026

Same author

Reduced but Reversible Brain Entropy After Occupational Partial Sleep Deprivation in Night-Shift Medical Staff.

Brain and behavior·2026

Same author

High-fidelity three-dimensional reconstruction of musculoskeletal tissues via diffusion based ultrasonic computed tomography.

Medical image analysis·2026

Same author

Weight-adjusted waist index and cognitive impairment in older adults: A nationwide longitudinal cohort study.

Medicine·2026

Same author

Integrating mechanical cues in <i>in vitro</i> models of immune-related fibrotic diseases.

Frontiers in immunology·2026

Same author

Closed-loop correction reprogramming for fine-grained visual prompting.

Neural networks : the official journal of the International Neural Network Society·2026

Same journal

CEST MRI reveals nicotine-induced alterations in glutamate-associated molecular connectivity in the mouse brain.

Frontiers in neuroscience·2026

Same journal

Brain protein burden is related to intravoxel incoherent motion: PET-MR imaging study.

Frontiers in neuroscience·2026

Same journal

Screening the optimal rTSMS frequency to orchestrate immune-fibrotic remodeling for adult spinal cord repair.

Frontiers in neuroscience·2026

Same journal

Assessment of tenecteplase target-associated pathogenic mechanisms underlying depression in acute ischemic stroke patients: insights from artificial intelligence-driven multi-omics analysis and <i>in vitro</i> validation.

Frontiers in neuroscience·2026

Same journal

Sex-divergent intrinsic brain function in Parkinson's disease: elevated nigral fluctuations and premotor-visuospatial coupling in female patients.

Frontiers in neuroscience·2026

Same journal

Spatial transcriptomics on an expanded dataset at the brain-electrode interface: exploration of variability and identification of novel biomarkers.

Frontiers in neuroscience·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Oct 25, 2025

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

Auditory Attention Detection via Cross-Modal Attention.

Siqi Cai¹, Peiwen Li¹, Enze Su¹

¹Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou, China.

Frontiers in Neuroscience

|August 9, 2021

Summary

This summary is machine-generated.

This study introduces a new cross-modal attention-based auditory attention detection (AAD) method using electroencephalography (EEG) and audio signals. The novel approach significantly improves real-time speech stream selection accuracy, outperforming existing methods.

Keywords:

EEG attention mechanism auditory attention cocktail party cross-modal

More Related Videos

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control

Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control

Published on: July 5, 2015

Related Experiment Videos

Last Updated: Oct 25, 2025

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control

Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control

Published on: July 5, 2015

Area of Science:

Neuroscience
Signal Processing
Machine Learning

Background:

Humans possess advanced auditory attention capabilities to isolate desired speech streams in noisy environments.
Auditory attention detection (AAD) using electroencephalography (EEG) shows promise but struggles with short signal segments and real-time applications.
Existing AAD methods lack robustness, necessitating advanced decoding strategies for reliable performance.

Purpose of the Study:

To develop a novel cross-modal attention-based AAD (CMAA) approach.
To leverage correlations between audio and EEG signals for enhanced attention detection.
To improve the accuracy and robustness of real-time AAD.

Main Methods:

Proposed a cross-modal attention-based AAD (CMAA) network.
Exploited discriminative features and cross-modal correlations between audio and EEG.
Utilized data visualization and comprehensive experiments on a public database.

Main Results:

Achieved high accuracy rates: 82.8% (1s), 86.4% (2s), and 87.6% (5s) under anechoic conditions.
Attained 84.1% accuracy with a 2s window in reverberant conditions.
Outperformed conventional linear and state-of-the-art non-linear AAD approaches.

Conclusions:

The CMAA model effectively fuses cross-modal information by attending to audio and EEG features.
CMAA demonstrates superior performance in auditory attention detection compared to existing methods.
The findings support the potential of CMAA for robust real-time AAD applications.