通过使用深度神经网络模拟的耳植入信号来估计音调信息
Takanori Ashihara1,2, Shigeto Furukawa3,4,5, Makio Kashino5
1NTT Human Informatics Laboratories, NTT Corporation, Kanagawa, Japan.
Trends in hearing
|November 21, 2024
概括
耳植入物 (CI) 传递基本频率 (F0) 信息,但音调感知有所不同. 时间分辨率,特别是脉冲率,在杂的环境中对F0至关重要.
科学领域:
- 听觉神经科学 听觉神经科学
- 信号处理 信号处理
- 医疗器械 医疗器械
背景情况:
- 耳植入物 (CI) 使用者往往对基本频率 (F0) 敏感性有限,影响音调感知.
- 这种不敏感性通常归因于CI信号中的光谱和时间分辨率极限.
- 然而,个体变异性表明其他生理因素,如神经可塑性也起作用.
研究的目的:
- 为了确定可通过耳植入物 (CI) 信号传输的最大基本频率 (F0) 信息.
- 调查光谱 (电极通道) 和时间 (脉冲率) 分辨率对F0估计的影响.
- 为了将CI信号F0估计与原始波形处理进行比较,特别是在噪音条件下.
主要方法:
- 开发了一个深度神经网络 (CI模型) 来从模拟的CI信号中解码F0.
- 改变了电极通道数量和脉冲率,以模拟不同的光谱和时间分辨率.
- 将CI模型性能与使用原始音频输入的控制波形模型进行比较.
主要成果:
- 随着电极通道和脉冲率的增加,F0估计性能得到了改善.
- 在安静条件下,CI模型的性能与波形模型相当.
- 在背景噪音的存在下,CI模型的性能比波形模型更恶化.
- 脉冲率显著影响了F0估计性能,特别是在噪音方面.
结论:
- CI信号含有足够的F0信息来感知,特别是在安静的环境中.
- 时间分辨率,以脉冲率表示,对于CI用户在噪音条件下对音调感知至关重要.
- 在F0灵敏度的个体差异可能源于超出信号处理限制的神经因素.
相关概念视频
01:13The Cochlea
44.5K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
44.5K
01:21Perceiving Loudness, Pitch, and Location
194
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
194
01:22Hair Cells
40.1K
Hair cells are the sensory receptors of the auditory system—they transduce mechanical sound waves into electrical energy that the nervous system can understand. Hair cells are located in the organ of Corti within the cochlea of the inner ear, between the basilar and tectorial membranes. The actual sensory receptors are called inner hair cells. The outer hair cells serve other functions, such as sound amplification in the cochlea, and are not discussed in detail here.
40.1K
01:31Hearing
51.8K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.8K