使用脑电图和音频空间频谱对听话者方向的多类解码
概括
这项研究通过将EEG与空间音频信息相结合来增强听觉注意力解码,提高了从多个来源识别特定扬声器方向的能力.
科学领域:
- 神经科学是一个神经科学.
- 信号处理 信号处理
- 机器学习 机器学习
背景情况:
- 选择性听觉注意力解码 (sAAD) 研究主要集中在二进制左右任务上.
- 解读听众演讲者的准确方向至关重要,但具有挑战性.
- 现有的方法往往无法充分利用空间音频线索,从而限制了性能.
研究的目的:
- 为了改进超越二进制任务的定向焦点解码.
- 为了利用空间音频信息与EEG一起进行增强的SAAD.
- 评估不同的模型架构和融合策略,用于多方向解码.
主要方法:
- 利用一个数据集,同时使用两个扬声器在14个可能的方向.
- 综合空间光谱作为电脑图 (EEG) 模型的额外输入.
- 评估了CNN,LSM-CNN和Deformer架构,使用全合一和双向解码策略.
主要成果:
- 拟议的Sp-EEG-Deformer模型实现了14类解码精度为55.35% (离开一个主体) 和57.19% (离开一个试验) 的1秒窗口.
- 一个配对的Sp-EEG-Deformer解码器在10秒的窗口中达到63.62%的准确性.
- 空间光谱有效地将问题降低到二进制分类,而EEG完善了最终的方向识别.
结论:
- 整合空间光谱与EEG显著提高了多方向听觉注意力解码.
- 拟议的双模方法,特别是Sp-EEG-Deformer,为精确的扬声器定位提供了一个有希望的解决方案.
- 这项研究提升了对复杂的听觉环境的SAAD能力.
更多相关视频
11:25Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding
Published on: July 26, 2013
43.5K
11:14A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
Published on: October 4, 2015
11.1K
相关概念视频
Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
