利用耳植入式麦克风的空间线索,在自然倾听场景中有效地增强语音分离
Feyisayo Olalere1, Kiki van der Heijden2,3, H Christiaan Stronks4
1Donders Institute for Brain, Cognition and Behavior, Radboud University, Nijmegen, The Netherlands. feyisayo.olalere@donders.ru.nl.
Scientific reports
|December 15, 2025
概括
深度神经网络使用来自耳植入物 (CI) 麦克风的空间线索,改善了在反响环境中的语音分离. 这种增强甚至在有损音频输出的情况下也持续存在,使CI用户受益.
科学领域:
- 听觉神经科学 听觉神经科学
- 信号处理 信号处理
- 机器学习 机器学习
背景情况:
- 在反响,自然的环境中,语音分离具有挑战性.
- 目前的方法限制了助听器和耳植入器 (CI) 设备.
- 来自CI麦克风的空间信息可能会改善语音分离.
研究的目的:
- 调查深度神经网络 (DNN) 使用语音分离的空间线索.
- 评估语音分离的潜在和预计算的空间线索 (ILD,IPD).
- 在CI模拟中评估空间线索对DNN性能和效率的影响.
主要方法:
- 开发了一种用于语音分离的双通道SuDoRM-RF DNN模型.
- 输入:用两个CI麦克风录制的语音混合.
- 测试了潜在的空间线索和预先计算的通道间水平差异 (ILD) 和通道间相差 (IPD).
主要成果:
- 隐藏的空间线索增强了语音分离性能,而不会影响模型效率.
- 预先计算的空间线索,特别是IPD,进一步改善了分离,但降低了效率.
- 模拟的CI语音编码器输出显示,尽管有音频退化,空间提示的好处仍然存在.
结论:
- DNN可以有效地利用CI麦克风的空间信息来改善语音分离.
- 隐藏和预计算的空间线索都提供了好处,但在效率上有权衡.
- 空间暗示增强分离有望改善CI用户的语音可理解性.
相关概念视频
Perceiving Loudness, Pitch, and Location
892
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
892
Auditory Perception
992
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
992
Hearing
56.3K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
56.3K
Auditory Pathway
7.0K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
7.0K
Impression Management Techniques IV: Altercasting
157
Altercasting is a strategic communication technique in which an individual imposes a specific identity or social role onto another person to influence their behavior and shape the interaction. By presuming a role—such as “responsible leader” or “patient person”—altercasting encourages the target to conform to that identity, often aligning their behavior with the expectations associated with the role. The power of this tactic lies in its subtlety; once a role...
157
Perception of Sound Waves
5.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.4K


