从感觉运动皮层进行跨扬声器关重建,用于可概括的大脑与计算机接口.
Ruoling Wu1, Julia Berezutskaya2, Zachary V Freudenburg3
1University Medical Centre Utrecht Brain Centre, Heidelberglaan 100, Utrecht, Utrecht, 3584 CX, Netherlands.
Journal of neural engineering
|March 3, 2026
概括
这项研究表明,可以利用张量组件分析 (TCA) 从大脑活动中提取可概括的关节特征. 这种方法成功地从高密度电皮质谱 (HD-ECoG) 信号中重建了语音特征,为语音脑电脑接口 (BCI) 提供了新的可能性.
科学领域:
- 神经科学是一个神经科学.
- 生物医学工程 生物医学工程
- 语音科学 语言科学
背景情况:
- 语音脑电脑接口 (BCI) 旨在通过解码大脑活动来恢复语音.
- 患有声道的个体在言语BCI发展方面面临挑战,原因是缺少关节运动.
- 提取可概括的发音特征对于强大的语音BCI表现至关重要.
研究的目的:
- 从荷兰语母语使用者的数据集中提取可概括的发音特征.
- 通过使用高密度电皮质谱 (HD-ECoG) 来重建这些关节特征,从有能力的个体的大脑活动中重建这些关节特征.
- 评估使用可概括特征用于患者的言语BCI发育的可行性.
主要方法:
- 张量组件分析 (TCA) 用于从运动数据中识别可概括的关节特征.
- 分析了三名参与者的HD-ECoG数据,以提取神经特征.
- 一个渐变增强回归模型从神经特征预测了关节特征.
- 使用皮尔森相关系数 (PCC) 量化重建性能.
主要成果:
- 提取的关节特征在参与者之间展示了一致的贡献,表明了可概括性.
- 从HD-ECoG数据中成功重建了关节的特征.
- 三位参与者的PCC平均值为0.80,0.75和0.76,明显高于随机.
结论:
- 与语音相关的发音特征可以使用可概括特征从HD-ECoG信号中恢复.
- 这一框架显示出开发语音BCI的前景,适用于无法表达口腔动作的人.
- 重建的关节特征可能能够生成与音频或语音相关的面部运动.
相关概念视频
Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Motor and Sensory Areas of the Cortex
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
Spinal Cord: Information Processing
The spinal cord is an integral hub for motor and sensory information that enables the brain to communicate with the peripheral nervous system (PNS). This communication consists of relaying sensory data and transmission of motor commands.
Sensory Information Processing
Sensory information processing begins at the sensory receptors located in the skin and other tissues, which detect somatic sensory stimuli such as touch, temperature, or pain. These receptors function as catalysts, initiating...
Sensory Information Processing
Sensory information processing begins at the sensory receptors located in the skin and other tissues, which detect somatic sensory stimuli such as touch, temperature, or pain. These receptors function as catalysts, initiating...
Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...


