深度声音合成与大脑活动相匹配,总结了对语言和音乐的偏好反应
Lidongsheng Xing 邢立冬生1, Elia Formisano2,3,4, Lars Riecke2
1Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, 6200 MD, Maastricht, Netherlands. xinglds@163.com.
概括
人类的听觉系统使用抽象的内部表征,而不仅仅是声学特征,来分类语音和音乐等声音. 这些用深度神经网络 (DNN) 识别的表示是理解听觉感知的关键.
科学领域:
- 神经科学是一个神经科学.
- 听觉感知是一种听觉感知.
- 计算式听觉神经科学 计算式听觉神经科学
背景情况:
- 人类的听觉系统将环境声音分类为语义组,如语音和音乐.
- 涉及到不同的声学特征和听觉皮层区域,但内部表征的理解很差.
研究的目的:
- 调查听力皮层的内部声音特征,用于语音和音乐的分类.
- 了解这些表示在声音分类中的功能作用.
主要方法:
- 结合神经成像,深度神经网络 (DNN) 分析,基于大脑的声音合成和心理物理测试.
- 合成来自皮质活动模式的声音来测试听力皮质反应.
- 研究了人类参与者对合成声音的行为和神经反应.
主要成果:
- 从皮质活动中合成的声音引起了与自然语音和音乐相似的分类反应.
- 这些合成声音在声学上与自然的语言和音乐不同.
- 听觉皮层的反应表明它依赖于抽象的,内部的类别结构.
结论:
- 听觉分类依赖于内部,抽象的表示,不能归结为自然的声学特性.
- 深度神经网络 (DNN) 捕获与听觉分类相关的中间声音特征.
- 这些发现为声音含义提取的神经基础提供了新的见解.
相关概念视频
Sign Test for Matched Pairs
405
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
405
Korotkoff Sounds
8.1K
Korotkoff sounds are the specific sounds heard while measuring blood pressure using a sphygmomanometer, typically with a stethoscope or a Doppler device. They are named after Russian physician Nikolai Korotkov, who first described them in 1905. These sounds correspond to turbulent blood flow in the artery as the blood pressure cuff is gradually released after inflation.
During blood pressure assessment, inflating the cuff 30 millimeters of mercury above the patient's systolic blood pressure...
During blood pressure assessment, inflating the cuff 30 millimeters of mercury above the patient's systolic blood pressure...
8.1K
Heart Sounds
3.6K
Heart sounds are generated by the turbulence in blood flow due to the closing of heart valves. These sounds are best perceived slightly away from the valves, where the blood flow disseminates the sound.
Auscultation is the process of listening to these internal body sounds using a stethoscope. The heart produces four types of sounds, but only two—S1 and S2—can usually be heard with a stethoscope.
S1, also known as the "lub" sound, is caused by the closure of atrioventricular (A-V)...
Auscultation is the process of listening to these internal body sounds using a stethoscope. The heart produces four types of sounds, but only two—S1 and S2—can usually be heard with a stethoscope.
S1, also known as the "lub" sound, is caused by the closure of atrioventricular (A-V)...
3.6K
Soundness of Cement
561
The soundness of cement refers to the ability of cement paste to retain its volume after setting. Unsound cement can lead to expansion and structural damage due to the presence of free lime, magnesia, and calcium sulfate. Free lime hydrates very slowly, expanding and causing unsoundness, which is difficult to detect because it intercrystallizes with other compounds. Magnesia also reacts with water, forming crystals that can disrupt the cement's structure. Calcium sulfate can create...
561
Sound Waves
13.0K
Sound waves can be thought of as fluctuations in the pressure of a medium through which they propagate. Since the pressure also makes the medium's particles vibrate along its direction of motion, the waves can be modeled as the displacement of the medium's particles from their mean position.
Sound waves are longitudinal in most fluids because fluids cannot sustain any lateral pressure. In solids, however, shear forces help in propagating the disturbance in the lateral direction as well....
Sound waves are longitudinal in most fluids because fluids cannot sustain any lateral pressure. In solids, however, shear forces help in propagating the disturbance in the lateral direction as well....
13.0K
Sound Intensity
4.8K
The loudness of a sound source is related to how energetically the source is vibrating, consequently making the molecules of the propagation medium vibrate. To measure the loudness of a source, the physical quantity of interest is the intensity. This is defined as the energy emitted per unit of time per unit of area perpendicular to the sound wave's propagation direction. Since the total energy is greater if the source vibrates for a longer duration and over a larger area, dividing the...
4.8K


