一个功能集成网络,用于多道语音增强.
Xiao Zeng1, Xue Zhang1, Mingjiang Wang1
1Key Laboratory for Key Technologies of IoT Terminals, Harbin Institute of Technology, Shenzhen 518055, China.
Sensors (Basel, Switzerland)
|November 27, 2024
概括
这项研究引入了一种用于多通道语音增强的新型网络,通过转移窗口自我注意力改进光谱特征提取. 拟议的模型有效地在杂的环境中提炼语音信号,实现竞争性性能.
科学领域:
- 信号处理 信号处理
- 机器学习 机器学习
背景情况:
- 多通道语音增强对于从噪音中恢复语音至关重要.
- 最近的方法利用光谱信息来提高性能.
研究的目的:
- 提出一种新的功能集成网络,用于增强语音信号恢复.
- 使用先进的注意力机制,提高特征提取的精度.
主要方法:
- 开发了一个集成全频段和子频段LSTM模块的网络,用于光谱信息捕获.
- 采用全球-本地注意力融合模块,采用双分支架构.
- 利用基于转移窗口的自我注意力来精炼特征,并利用空间注意力来融合.
- 训练模型来预测复杂比率面罩 (CRM) 用于信号增强.
主要成果:
- 废弃性研究证实了每个模块的显著性能贡献.
- 该模型在SPA-DNS和Libri-wham数据集上取得了竞争性结果.
- 在语音信号恢复中证明了提高质量和精度.
结论:
- 拟议的功能集成网络有效地增强了多道语音.
- 转移窗口自我注意力和注意力融合模块是提高性能的关键.
- 该模型在噪音条件下显示出对现实世界的应用有希望.
相关概念视频
Integrator and Differentiator
771
Op-amp circuits have significant applications in various fields, including automotive engineering. One such application is cruise control systems in cars, where op-amp circuits are integral for maintaining a constant speed. In these systems, op-amps function as both integrators and differentiators.
An integrator within an op-amp circuit produces an output directly proportional to the integral of the input signal. This is achieved by replacing the feedback resistor in a typical inverting...
An integrator within an op-amp circuit produces an output directly proportional to the integral of the input signal. This is achieved by replacing the feedback resistor in a typical inverting...
771
Multi-input and Multi-variable systems
96
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
96
Design Example
316
The innovation of touch-tone telephony revolutionized the telecommunications industry by replacing the traditional rotary dial with a dual-tone multi-frequency (DTMF) signaling system. This system uses a matrix-style keypad with buttons arranged in four rows and three columns, creating 12 distinct signals each assigned to a pair of frequencies. Each button press results in a simultaneous generation of two sinusoidal tones – one from a low-frequency group (697 to 941 Hz) and one from a...
316
Perceiving Loudness, Pitch, and Location
194
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
194
Reconstruction of Signal using Interpolation
173
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
173
Double Resonance Techniques: Overview
191
Double resonance techniques in Nuclear Magnetic Resonance (NMR) spectroscopy involve the simultaneous application of two different frequencies or radiofrequency pulses to manipulate and observe two distinct nuclear spins. One important application of double resonance is spin decoupling, which selectively suppresses coupling with one type of nucleus while observing the NMR signal from another nucleus, simplifying the spectrum and enhancing resolution.
Spin decoupling is usually achieved by...
Spin decoupling is usually achieved by...
191


