在反响和反响噪音环境中对基于DNN的语音增强进行系统研究
Heming Wang1, Ashutosh Pandey1, DeLiang Wang1,2
1The Ohio State University, 281 W Lane Ave, Columbus, 43210 OH, United States.
Computer speech & language
|September 2, 2025
概括
深度神经网络 (DNN) 改善了语音增强. 这项研究表明,具有更大的窗口大小和转换操作的时间域模型实现了优异的语音失声性能.
科学领域:
- 人工智能
- 信号处理
- 听力学
背景情况:
- 深度神经网络 (DNN) 显著提升了语音增强.
- 目前基于DNN的方法主要使用频域来实现语音脱声.
- 时间域方法通常被认为对脱声效果不那么有效.
研究的目的:
- 研究时间域深度学习模型对语音增强的有效性.
- 系统地分析各种组件对语音失声表现的影响.
- 为了比较注意的循环网络 (ARN) 和密集连接的卷积循环网络 (DC-CRN) 的性能.
主要方法:
- 使用两个深度神经网络:RNA和DC-CRN.
- 研究了窗口大小,损失函数和特征表示的影响.
- 仅在反响和反响噪音条件下进行评估.
- 用于波形特征编码/解码的内置转换操作 (卷积或线性).
主要成果:
- 发现更大的窗户尺寸有利于脱声.
- 转换操作提高了学习表达的稀疏性,并提高了时间域模型的性能.
- 拟议的技术提高了RNA和DC-CRN模型的性能.
- 与现有的强大增强基线相比,实现了更高的性能.
结论:
- 时间域深度学习模型对于语音增强是非常有效的,特别是在优化组件的情况下.
- 整合转换操作和更大的窗口大小代表了语音脱声的重大进步.
- 随着这些技术的增强,ARN和DC-CRN模型在具有挑战性的声学环境中表现优于传统方法.
相关概念视频
Neural Regulation
39.9K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
39.9K
Perceiving Loudness, Pitch, and Location
420
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
420
Elaborative Rehearsals
129
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
The effectiveness of...
129
Chunking and Rehearsal in Sensory Memory
293
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
293


