通过使用非线性解码模型,可以从人类听觉皮层活动中重建音乐
Ludovic Bellier1, Anaïs Llorens1, Déborah Marciano1
1Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California, United States of America.
PLoS biology
|August 15, 2023
概括
科学家们使用内脑电图 (iEEG) 从大脑活动中重建了音乐. 这揭示了右半球在音乐感知和节奏处理的上时中占主导地位,从而提升了大脑与计算机界面的潜力.
科学领域:
- 神经科学是一个神经科学.
- 听觉感知是一种听觉感知.
- 大脑与计算机的接口
背景情况:
- 音乐感知是人类体验的基础,但它的神经支柱尚未完全理解.
- 以前的研究主要集中在更广泛的听觉处理上,使特定的音乐动态不清楚.
研究的目的:
- 用内脑电图 (iEEG) 来研究音乐感知的神经动力学.
- 应用从语音处理中调整的刺激重建技术,以分析从神经数据中解码的音乐.
- 确定涉及处理音乐元素 (如节奏) 的大脑区域和组织原则.
主要方法:
- 对29名听Pink Floyd歌曲的患者独特的iEEG数据集的分析.
- 应用刺激重建方法来解码来自神经记录的音乐信息.
- 结合编码和解码分析,以评估神经反应和预测准确度.
主要成果:
- 从直接的神经记录中成功重建了一首可识别的歌曲.
- 对影响音乐解码精度的因素的量化.
- 在音乐感知中,右半球占据主导地位的证据,特别是涉及上旋 (STG).
- 确定一个专门用于音乐节奏处理的新型STG子区域.
- 在STG中定义前后组织,对音乐元素表现出明显的持续和发病反应.
结论:
- 预测建模是可行的,即使从单个患者的短数据集.
- 上旋在音乐感知中起着至关重要的作用,具有独特的子区域和组织模式.
- 这些发现为将音乐元素集成到脑电脑界面 (BCI) 应用程序中打开了道路.
更多相关视频
11:14A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
Published on: October 4, 2015
11.0K
13:05Functional Magnetic Resonance Imaging fMRI with Auditory Stimulation in Songbirds
Published on: June 3, 2013
18.2K
相关概念视频
Hearing
52.5K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.5K
Reconstruction of Signal using Interpolation
236
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
236
Auditory Perception
364
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
364
