Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

The Cochlea01:13

The Cochlea

52.6K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
52.6K
Auditory Pathway01:15

Auditory Pathway

8.9K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
8.9K
Hearing01:31

Hearing

58.8K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
58.8K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

1.3K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.3K
Auditory Perception01:17

Auditory Perception

1.5K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.5K
Anatomy of the Ear01:16

Anatomy of the Ear

13.7K
Auditory sensation, commonly called hearing, involves the transformation of sonic waves into neural impulses facilitated by the structures of the auditory organ. The prominent, flesh-like structure on the side of the head, called the auricle, directs sound waves towards the auditory canal. The auricle is often mislabeled as the pinna, a term more aligned with mobile structures like a feline's external ear. The auditory canal penetrates the cranium via the external auditory meatus of the...
13.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Targeting microglial circMBNL1 unlocks a novel nanomedicine therapeutic strategy for major depressive disorder.

Journal of nanobiotechnology·2026
Same author

Composite probiotics improve growth performance and enhance immune and antioxidant capacity in weaned yaks by modulating rumen microbiota and their metabolites.

BMC microbiology·2026
Same author

Achieving 20.5% Efficiency in Organic Solar Cells via Co-Crystallizable Small Molecule Acceptors.

Advanced materials (Deerfield Beach, Fla.)·2026
Same author

Observation of Structural Transition and Metallization in a van der Waals Diamagnet ZnPS<sub>3</sub> via Pressure Manipulation.

ACS omega·2026
Same author

Drp1-driven fragmentation of scleral mitochondria promotes myopia development.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Ultra-High Dielectric Acceptor Enables 21% Efficiency and Thickness-Insensitive Organic Solar Cells.

Advanced materials (Deerfield Beach, Fla.)·2026
Same journal

A Survey on Human-Centric Voice-Face Multimodal Learning.

IEEE transactions on neural networks and learning systems·2026
Same journal

Vision-Assisted Foundation Model for Solving Multitask Vehicle Routing Problems.

IEEE transactions on neural networks and learning systems·2026
Same journal

FP3O: Enabling Proximal Policy Optimization in Multiagent Cooperation With Parameter-Sharing Versatility.

IEEE transactions on neural networks and learning systems·2026
Same journal

Hierarchical Semantic Concept Modeling for Generalizable Myocardial Pathology Segmentation on Multisequence CMR Images.

IEEE transactions on neural networks and learning systems·2026
Same journal

Stability of Time-Varying Impulsive Systems With State-Dependent Delay and Its Application in Complex Networks.

IEEE transactions on neural networks and learning systems·2026
Same journal

Adaptive Learning Control of Uncertain Systems via Weight and Intrinsic Plasticity-Based Neural Networks.

IEEE transactions on neural networks and learning systems·2026
See all related articles

Related Experiment Video

Updated: Apr 2, 2026

A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

7.0K

TS-Binaural: Visually Guided Binaural Audio Generation by Temporal-Spatial Dynamic Analysis.

Shulin Liu, Haonan Cheng, Zhicheng Lian

    IEEE Transactions on Neural Networks and Learning Systems
    |March 31, 2026
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces TS-Binaural, a new method for visually guided binaural audio generation (VGBAG) that accurately models dynamic audio-visual relationships in complex music performances. TS-Binaural enhances spatial audio reconstruction by analyzing temporal-spatial dynamics and separating sound sources.

    More Related Videos

    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
    08:45

    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

    Published on: October 24, 2012

    15.3K
    Sound Source Localization Testing in Single-sided Deafness Following Bone Conduction Intervention
    04:32

    Sound Source Localization Testing in Single-sided Deafness Following Bone Conduction Intervention

    Published on: December 20, 2024

    990

    Related Experiment Videos

    Last Updated: Apr 2, 2026

    A Method to Study Adaptation to Left-Right Reversed Audition
    07:14

    A Method to Study Adaptation to Left-Right Reversed Audition

    Published on: October 29, 2018

    7.0K
    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
    08:45

    Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

    Published on: October 24, 2012

    15.3K
    Sound Source Localization Testing in Single-sided Deafness Following Bone Conduction Intervention
    04:32

    Sound Source Localization Testing in Single-sided Deafness Following Bone Conduction Intervention

    Published on: December 20, 2024

    990

    Area of Science:

    • Computer Vision
    • Audio Signal Processing
    • Machine Learning

    Background:

    • Visually guided binaural audio generation (VGBAG) methods struggle with dynamic audio-visual relationships in complex, multisource scenarios like musical performances.
    • Existing VGBAG techniques fail to accurately model the variable number of sound sources, performance styles, and stage effects common in music videos, leading to inaccurate binaural audio reconstruction.

    Purpose of the Study:

    • To propose a novel VGBAG method, TS-Binaural, that effectively addresses the limitations of existing approaches in modeling dynamic audio-visual relationships for musical instrument performance videos.
    • To improve the accuracy of binaural audio generation by incorporating temporal-spatial dynamic analysis (TSDA) and a "separation-later-mixing" strategy.

    Main Methods:

    • Developed TS-Binaural, a VGBAG method based on temporal-spatial dynamic analysis (TSDA).
    • Introduced a "separation-later-mixing" strategy to process complex audio-visual scenes by splitting them into separate units.
    • Designed an automatic mask generation-based performance analyzer (AMGPA) with position detection logic to identify and separate activation regions, preventing intersource interference.

    Main Results:

    • The proposed TS-Binaural method demonstrated superior performance compared to state-of-the-art VGBAG methods in extensive quantitative and qualitative evaluations.
    • The AMGPA effectively identified and separated distinct visual regions corresponding to performers and instruments, mitigating intersource interference.

    Conclusions:

    • TS-Binaural offers a significant advancement in VGBAG, particularly for complex musical performance scenarios, by effectively handling dynamic audio-visual information.
    • The temporal-spatial dynamic analysis and separation-later-mixing strategy are key innovations enabling more accurate and robust binaural audio generation from visual input.