专注训练:用于增强语音的新训练框架
Ashutosh Pandey1, DeLiang Wang2
1Department of Computer Science and Engineering, The Ohio State University, Columbus, OH 43210 USA.
IEEE/ACM transactions on audio, speech, and language processing
|October 30, 2023
概括
本研究介绍了注意力训练,这是一种通过专注于噪音环境中的第一个演讲者来改进语音增强系统的新方法. 这种方法有效地处理单个输出系统中的语音中断.
科学领域:
- 语音处理 语音处理
- 深度学习是一种深度学习.
- 信号处理 信号处理
背景情况:
- 语音增强系统经常与多个扬声器和噪音作斗争.
- 现有的方法,如扬声器分离或提取,对于单个输出系统有局限性.
研究的目的:
- 提出一个新的训练框架,注意力训练,用于语音增强系统.
- 为了使语音增强系统能够有效地处理来自多个演讲者的语音中断.
主要方法:
- 开发了一种名为注意力训练的新型训练框架.
- 训练了一个深度神经网络,以代表和跟踪在杂的混合物中第一个扬声器.
主要成果:
- 证明了注意力训练对语音增强的有效性.
- 展示了在多语者噪音条件下关注和跟踪目标扬声器的能力.
结论:
- 注意训练是一种可行的解决方案,可以在出现中断的情况下增强语音.
- 拟议的方法适用于单独的语音增强系统,具有单个输出流.
相关概念视频
01:27Air-entraining Agents
81
Air-entraining agents improve the durability and workability of concrete in climates with frequent freezing and thawing. These agents prevent cracks by introducing small air bubbles into the mix, creating spaces accommodating water expansion when temperatures drop. The air-entraining agents lower the surface tension of water, forming stable, small air bubbles. This method is more effective than having accidental large voids, as the intentional, smaller, and evenly distributed air voids improve...
81
01:21Perceiving Loudness, Pitch, and Location
220
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
220