Enhancing speech intelligibility in optical microphone systems through physics-informed data augmentation

Jia-Wei Chen1, Jia-Hui Li1, Yi-Hao Jiang1

  • 1Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan.

JASA Express Letters
|April 2, 2025
PubMed

Related Concept Videos

Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Doppler Effect - II01:05

Doppler Effect - II

The Doppler effect has several practical, real-world applications. For instance, meteorologists use Doppler radars to interpret weather events based on the Doppler effect. Typically, a transmitter emits radio waves at a specific frequency toward the sky from a weather station. The radio waves bounce off the clouds and precipitation and travel back to the weather station. The radio frequency of the waves reflected back to the station appears to decrease if the clouds or precipitation are moving...
Echo01:06

Echo

The human ear cannot distinguish between two sources of sound if they happen to reach within a specific time interval, typically 0.1 seconds apart. More than this, and they are perceived as separate sources.
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case, then the...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...