Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Perception of Sound Waves

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...

Perceiving Loudness, Pitch, and Location

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Surgical Video Understanding with Alignment-Preserving Temporal Adaptation and Action Triplet Text Alignment.

Bioengineering (Basel, Switzerland)·2026

Same author

Transfer Learning Strategies for Pathological Foundation Models: A Systematic Evaluation in Brain Tumor Classification.

Pathology international·2026

Same author

Privacy-Aware Continual Self-Supervised Learning on Multi-Window Chest Computed Tomography for Domain-Shift Robustness.

Bioengineering (Basel, Switzerland)·2026

Same author

Enhancing Adversarial Defense via Brain Activity Integration Without Adversarial Examples.

Sensors (Basel, Switzerland)·2025

Same author

Expert Comment Generation Considering Sports Skill Level Using a Large Multimodal Model with Video and Spatial-Temporal Motion Features.

Sensors (Basel, Switzerland)·2025

Same author

Trial Analysis of Brain Activity Information for the Presymptomatic Disease Detection of Rheumatoid Arthritis.

Bioengineering (Basel, Switzerland)·2024

Search research articles

Related Experiment Video

Updated: Jul 30, 2025

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Off-Screen Sound Separation Based on Audio-visual Pre-training Using Binaural Audio.

Masaki Yoshida¹, Ren Togo², Takahiro Ogawa²

¹Graduate School of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-ku, Sapporo 060-0814, Hokkaido, Japan.

Sensors (Basel, Switzerland)

|May 13, 2023

Summary

This study introduces a new method for separating off-screen sounds using audio-visual pre-training and binaural audio. The approach effectively isolates sounds from outside the visual field, regardless of their direction.

Keywords:

audio-visual systems binaural audio off-screen sound pre-training sound source separation

More Related Videos

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

A Method to Study Adaptation to Left-Right Reversed Audition

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

Related Experiment Videos

Last Updated: Jul 30, 2025

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

A Method to Study Adaptation to Left-Right Reversed Audition

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

Area of Science:

Audio-visual learning
Signal processing
Machine learning

Background:

Audio-visual analysis often uses visual cues for sound manipulation.
Existing methods struggle with sounds lacking direct audio-visual correspondence (off-screen sounds).

Purpose of the Study:

To develop a novel method for off-screen sound separation.
To improve audio-visual learning by incorporating off-screen spatial information.

Main Methods:

Utilized audio-visual pre-training for sound separation.
Employed binaural audio to leverage sound arrival directions for 3D spatial awareness.
Developed a new pre-training strategy considering off-screen space.

Main Results:

Successfully separated off-screen sounds irrespective of their arrival direction.
Demonstrated effectiveness in both off-screen sound detection and separation tasks.
Validated through evaluations on generated video data.

Conclusions:

The proposed method effectively addresses the challenge of off-screen sound separation.
Audio-visual pre-training enhanced with off-screen spatial awareness improves performance.
The technique shows promise for real-world applications requiring robust sound localization.