混合EEG-fNIRS语音分类基于想象和感知语音的声音分类
Manuel Hons1, Silvia Erika Kober1, Selina Christin Wriessnegger2,3
1Department of Psychology, University of Graz, Graz, Austria.
Frontiers in neuroergonomics
|February 26, 2026
概括
这项研究结合了脑电图 (EEG) 和功能近红外光谱 (fNIRS) 来解码想象语音,达到77%的准确性. 主要由EEG驱动的混合方法对通信假肢有希望.
科学领域:
- 神经科学是一个神经科学.
- 生物医学工程 生物医学工程
- 信号处理 信号处理
背景情况:
- 严重的运动障碍限制了沟通,推动了用于语音假肢的脑计算机接口 (BCI) 的研究.
- 现有的BCI通常依赖于单模神经成像 (EEG或fNIRS),而多模方法的探索较少.
研究的目的:
- 调查混合电脑图 (EEG) 和功能近红外光谱 (fNIRS) 系统在想象和感知语音中的语音解码的有效性.
- 为了比较混合系统的性能与单式EEG和fNIRS系统.
主要方法:
- 在线语音解码是使用结合的EEG和fNIRS数据进行的,来自22名参与者想象和感知四种语音 (/a/, /i/, /b/, /k/).
- 提取的特征包括功率光谱密度 (EEG) 和平均血红蛋白度变化 (fNIRS).
- 相互信息标准和10倍交叉验证用于特征选择和模型优化.
主要成果:
- 混合分类实现了77.29%的精确度,用于想象语音和76.05%的感知语音.
- 在混合和仅EEG分类之间没有观察到显著的性能差异.
- 基于fNIRS的语音歧视与基于混合和EEG的方法相比,其准确性较低.
结论:
- 这项研究提出了多式EEG-fNIRS数据的创新应用,用于在想象和感知语音中解读音符.
- 四类想象语音分类主要是由EEG特征驱动的,其表现优于之前的研究.
- 这些发现表明,混合EEG-fNIRS系统有可能开发直观的语音假肢.
相关概念视频
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:19Encoding
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...