同时扬声器与声学矢量传感器的分离
Józef Kotus1, Grzegorz Szwoch1
1Department of Multimedia Systems, Faculty of Electronics, Telecommunication and Informatics, Gdansk University of Technology, 80-233 Gdansk, Poland.
Sensors (Basel, Switzerland)
|March 17, 2025
概括
这项研究引入了一种新的声音源分离技术,使用对现场音频的声音强度分析. 该方法有效地隔离了所需的声音,在杂的环境中显著提高了语音可理解性.
科学领域:
- 声学 声学 在声学方面
- 信号处理 信号处理
- 机器学习 机器学习
背景情况:
- 现场音频信号往往包含多个声音源,使特定声音的分析和提取具有挑战性.
- 传统的声音源分离方法与实时处理和复杂的声学环境作斗争.
- 声向量传感器提供丰富的空间信息,对于先进的信号处理至关重要.
研究的目的:
- 开发和评估一种用于实时音频信号的新声源分离方法.
- 为了提高自动语音识别和语音日记系统的性能.
- 通过使用紧的声学传感器,在具有并发语音的场景中实现有效的声音分离.
主要方法:
- 来自声向量传感器的声压信号被分析,以计算声音强度的2D光谱分布.
- 根据空间过的计算源方向选择光谱成分.
- 该方法用真实传感器脉冲响应和不同的源位置,包括多源场景进行了测试.
主要成果:
- 拟议的算法实现了10-12dB的信号与扭曲比 (SDR) 值.
- 短期目标可理解度 (STOI) 值提高了0.15-0.30,达到0.86-0.94.4.
- 证明了有效的声音源分离,即使有多个活跃源和不同的信号噪声比.
结论:
- 基于声音强度的空间过方法提供了一个强大的方法来分离现场声音源.
- 该技术显著提高了语音可理解性,适合实时应用.
- 这种方法为改进自动语音识别和语音日记系统提供了有价值的工具.
相关概念视频
IR Spectrum Peak Splitting: Symmetric vs Asymmetric Vibrations
876
Identical bonds within a polyatomic group can stretch symmetrically (in-phase) or asymmetrically (out-of-phase). Similar to hydrogen bonding, these vibrations also influence the shape of the IR peak. Generally, asymmetric stretching frequencies are higher than symmetric stretching frequencies. For example, primary amines exhibit two distinct IR peaks between 3300–3500 cm−1 corresponding to the symmetric and asymmetric N-H stretching, while secondary amines exhibit a single...
876
Echo
481
The human ear cannot distinguish between two sources of sound if they happen to reach within a specific time interval, typically 0.1 seconds apart. More than this, and they are perceived as separate sources.
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case,...
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case,...
481
Electronic Distance Measuring Instruments
22
Electronic Distance Measuring Instruments (EDMs) are essential tools in modern surveying, offering precise distance measurements by emitting electromagnetic signals and calculating the time required for these signals to travel to a target and return. Two primary types of signals are used in EDMs — light waves and microwaves — each suited to specific environmental and distance requirements. Light-wave-based EDMs utilize either infrared or laser light, providing high accuracy over short...
22
Interference: Path Lengths
1.3K
Consider two sources of sound, that may or may not be in phase, emitting waves at a single frequency, and consider the frequencies to be the same.
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
1.3K


