Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Perception of Sound Waves

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...

Auditory Perception

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...

Perceiving Loudness, Pitch, and Location

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...

Auditory Pathway

Auditory Pathway

Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...

Depth Perception and Spatial Vision

Depth Perception and Spatial Vision

Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.

Sound Waves: Interference

Sound Waves: Interference

Sound waves can be modeled either as longitudinal waves, wherein the molecules of the medium oscillate around an equilibrium position, or as pressure waves. When two identical waves from the same source superimpose on each other, the combination of two crests or two troughs results in amplitude reinforcement known as constructive interference. If two identical waves, that are initially in phase, become out of phase because of different path lengths, the combination of crests with troughs...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Antifungal susceptibility surveillance of clinical moulds to olorofim, manogepix, amphotericin B, triazoles and echinocandins at 10 tertiary hospitals in China (2019-24).

The Journal of antimicrobial chemotherapy·2026

Same author

Corrigendum to "Maternal bacteremia caused by <i>Listeria monocytogenes</i> ST87: A case report" [Heliyon Volume 9, Issue 4, April 2023, Article e14980].

Heliyon·2025

Same author

A late-onset hyperammonemia syndrome caused by <i>Ureaplasma parvum</i> infection after kidney transplantation.

Heliyon·2024

Same author

Bacillus licheniformis bloodstream infections associated with oral probiotic administration: Two case reports.

Indian journal of medical microbiology·2023

Same author

Maternal bacteremia caused by <i>Listeria monocytogenes</i> ST87: A case report.

Heliyon·2023

Same author

A multicenter investigation of 2,773 cases of bloodstream infections based on China antimicrobial surveillance network (CHINET).

Frontiers in cellular and infection microbiology·2023

Search research articles

Related Experiment Video

Updated: Jul 3, 2026

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

Perceptually coherent sound-space traversal for interactive systems via embeddings, VAE priors and diffusion

Linhua Duan¹, Yunjian Hu²

¹Department of Applied Arts, Kyung Hee University, Yongin-si, 17104, Republic of Korea.

Scientific Reports

|July 1, 2026

Summary

This study introduces a novel framework for interactive audio synthesis and traversal, enabling real-time control of vast audio archives. The hybrid model ensures smooth sound-space navigation and high-quality synthesis for interactive applications.

Keywords:

Diffusion-based synthesis Interactive art Multidimensional sound space Self-supervised embeddings Spatial audio rendering

More Related Videos

An Automated System for Sound Localization Testing in Hearing-Impaired Listeners

An Automated System for Sound Localization Testing in Hearing-Impaired Listeners

Published on: March 13, 2026

A Method to Study Adaptation to Left-Right Reversed Audition

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

Related Experiment Videos

Last Updated: Jul 3, 2026

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

An Automated System for Sound Localization Testing in Hearing-Impaired Listeners

An Automated System for Sound Localization Testing in Hearing-Impaired Listeners

Published on: March 13, 2026

A Method to Study Adaptation to Left-Right Reversed Audition

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

Area of Science:

Artificial Intelligence
Computer Science
Digital Signal Processing

Background:

Large audio archives are rich in sonic material but difficult to control interactively.
Existing methods often struggle with unconstrained audio generation and smooth transitions.

Purpose of the Study:

To present a framework for interactive latent audio synthesis and continuous sound-space traversal.
To enable controllable media from large audio archives for interactive contexts.

Main Methods:

Organized AudioSet using pretrained audio encoders (AudioMAE, CLAP) into a structured embedding space.
Employed a variational autoencoder (VAE) and latent diffusion model for smooth latent representation and refinement.
Utilized DDSP-based synthesis and Ambisonic spatialization for controllable waveforms and spatial rendering.
Incorporated gesture control at inference time for traversal and spatial modulation.

Main Results:

Achieved high CLAP similarity (0.82) and low mean F0 error (245.3 Hz).
Demonstrated spectral convergence (0.132) and low interactive latency (~35 ms).
Pilot evaluation indicated perceived smoothness, controllability, responsiveness, and creative usefulness.

Conclusions:

The hybrid framework provides technical evidence for latent continuity, synthesis stability, and real-time traversal feasibility.
Preliminary user evaluations suggest positive perceptual qualities for interactive audio applications.
The approach facilitates the use of large audio archives in interactive installations, live performance, and adaptive sound environments.