Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

844
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
844
Auditory Pathway01:15

Auditory Pathway

6.7K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
6.7K
Brain Imaging01:14

Brain Imaging

534
Brain imaging technologies provide critical insights into both the structure and function of the human brain, enabling medical professionals and researchers to diagnose, study, and treat neurological disorders or psychiatric disorders more effectively.
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans),  magnetic resonance imaging (MRI),  functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...
534
Hearing01:31

Hearing

55.9K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
55.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Real-time control of a hearing instrument with EEG-based attention decoding.

Journal of neural engineering·2025
Same author

Comparing human and machine speech recognition in noise with QuickSIN.

JASA express letters·2024
Same author

Coswara: A respiratory sounds and symptoms dataset for remote screening of SARS-CoV-2 infection.

Scientific data·2023
Same author

Multi-Modal Point-of-Care Diagnostics for COVID-19 Based on Acoustics and Symptoms.

IEEE journal of translational engineering in health and medicine·2023
Same author

Comment on the Point of View "Ecological Validity, External Validity and Mundane Realism in Hearing Science".

Ear and hearing·2022
Same author

ERP Evidences of Rapid Semantic Learning in Foreign Language Word Comprehension.

Frontiers in neuroscience·2022
Same journal

Analysis of End-Tidal CO2 Variability During Plateau Waves Episodes: An Information Theoretic Approach<sup></sup>.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

AI and Tomosynthesis for Breast Cancer Molecular Subtyping: A step toward precision medicine<sup></sup>.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Towards Sustainable Protein Recovery from Biological Waste: Assessing Polyethersulfone-based Microfiltration.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Analysis of the cardiovascular response to standardized polymicrobial peritonitis experimental model.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Automated Wrist Ultrasound Image Bone Enhancement and Segmentation Using Deep Learning.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

A Deep Learning approach for Depressive Symptoms assessment in Parkinson's disease patients using facial videos.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
See all related articles

Related Experiment Video

Updated: Dec 6, 2025

Inter-Brain Synchrony in Open-Ended Collaborative Learning: An fNIRS-Hyperscanning Study
04:44

Inter-Brain Synchrony in Open-Ended Collaborative Learning: An fNIRS-Hyperscanning Study

Published on: July 21, 2021

4.7K

Deep Canonical Correlation Analysis For Decoding The Auditory Brain.

Jaswanth Reddy Katthi, Sriram Ganapathy, Sandeep Kothinti

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
    |October 6, 2020
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces a deep learning framework to decode auditory brain activity from Electroencephalography (EEG) signals. The novel method significantly improves correlation, outperforming linear models for auditory attention decoding.

    More Related Videos

    Cross-Modal Multivariate Pattern Analysis
    13:51

    Cross-Modal Multivariate Pattern Analysis

    Published on: November 9, 2011

    20.3K
    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
    08:45

    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

    Published on: October 24, 2012

    15.0K

    Related Experiment Videos

    Last Updated: Dec 6, 2025

    Inter-Brain Synchrony in Open-Ended Collaborative Learning: An fNIRS-Hyperscanning Study
    04:44

    Inter-Brain Synchrony in Open-Ended Collaborative Learning: An fNIRS-Hyperscanning Study

    Published on: July 21, 2021

    4.7K
    Cross-Modal Multivariate Pattern Analysis
    13:51

    Cross-Modal Multivariate Pattern Analysis

    Published on: November 9, 2011

    20.3K
    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
    08:45

    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

    Published on: October 24, 2012

    15.0K

    Area of Science:

    • Neuroscience
    • Signal Processing
    • Machine Learning

    Background:

    • Decoding auditory brain activity from Electroencephalography (EEG) is crucial for understanding auditory perception.
    • Current methods often rely on linear analysis, such as Canonical Correlation Analysis (CCA), which may not fully capture complex neural responses.
    • High noise levels in EEG data present a significant challenge for accurate decoding.

    Purpose of the Study:

    • To develop and evaluate a deep learning framework for decoding the relationship between acoustic stimuli and EEG recordings.
    • To enhance the accuracy of auditory attention decoding, particularly in noisy conditions and complex auditory scenes.
    • To compare the performance of the proposed deep learning approach against traditional linear methods.

    Main Methods:

    • A deep learning framework was designed to maximize correlation between audio envelopes and EEG data.
    • Regularization techniques, including dropout, were employed to mitigate noise and improve model generalization.
    • Experiments were conducted using paired audio-EEG datasets, analyzing both forward and backward correlation models.

    Main Results:

    • The regularized deep Canonical Correlation Analysis (CCA) framework demonstrated superior performance compared to linear CCA.
    • An absolute improvement of up to 9% in Pearson correlation was achieved, which was statistically significant.
    • Analysis highlighted the effectiveness of dropout regularization in the deep CCA model for enhancing performance.

    Conclusions:

    • Deep learning-based correlation analysis offers a more effective approach for decoding auditory brain activity than linear methods.
    • The proposed method advances the decoding of human auditory attention, with implications for understanding speech segregation and source selection.
    • Potential applications include improving cochlear implants and Brain-Computer Interface (BCI) development, with possible extensions to other sensory modalities.