相关实验视频
Updated: Jul 23, 2026

14:58
Optical Scatter Microscopy Based on Two-Dimensional Gabor Filters
Published on: June 2, 2010
9.5K
在光学麦克风系统中通过基于物理的数据增强来提高语音可理解性
Jia-Wei Chen1, Jia-Hui Li1, Yi-Hao Jiang1
1Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan.
JASA express letters
|April 2, 2025
概括
这项研究引入了一种数据增强方法,以提高激光多普勒振动计 (LDV) 的语音清晰度. 该技术通过模拟材料扭曲和噪音,以更好地处理音频,从而提高噪音环境中的可理解性.
科学领域:
- 声学和信号处理
- 机器学习用于音频增强
- 生物医学工程 生物医学工程
背景情况:
- 激光多普勒振动仪 (LDV) 能够实现非接触式语音获取,但会受到物质依赖的扭曲和斑点噪声的影响.
- 这些扭曲会显著降低语音可理解性,尤其是在杂的环境中.
研究的目的:
- 提出一种新的数据增强方法来模拟和减轻LDV引起的语音扭曲.
- 在各种材料和低信号噪声比 (SNR) 条件下提高LDV录音的语音可理解性.
主要方法:
- 开发了一种数据增强技术,结合了特定材料和冲动噪声来模拟LDV扭曲.
- 采用一个封闭的卷积神经网络与HiFi-GAN集成,用于语音增强.
主要成果:
- 在0dB SNR下,获得了0.76的短期目标可理解性 (STOI) 评分.
- 在各种材料和低SNR场景中显著改善了语音可理解性.
结论:
- 拟议的数据增强和深度学习方法有效地提高了LDV录音的语音可理解性.
- 为优化增强策略和深度学习模型在实际的基于LDV的音频应用程序中提供了宝贵的见解.
相关概念视频
Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Doppler Effect - II
The Doppler effect has several practical, real-world applications. For instance, meteorologists use Doppler radars to interpret weather events based on the Doppler effect. Typically, a transmitter emits radio waves at a specific frequency toward the sky from a weather station. The radio waves bounce off the clouds and precipitation and travel back to the weather station. The radio frequency of the waves reflected back to the station appears to decrease if the clouds or precipitation are moving...
Echo
The human ear cannot distinguish between two sources of sound if they happen to reach within a specific time interval, typically 0.1 seconds apart. More than this, and they are perceived as separate sources.
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case, then the...
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case, then the...
Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...

