实时解码全频谱的中文使用大脑-计算机接口
Youkun Qian1,2,3, Changjiang Liu4, Peixi Yu5,6
1Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China.
Science advances
|November 5, 2025
概括
这项研究介绍了一个实时的大脑与计算机接口 (BCI),用于从神经信号直接解码普通话中文语音. 该系统在识别音节方面实现了71.2%的准确性,使言语障碍者能够进行句子交流.
科学领域:
- 神经科学是一个神经科学.
- 生物医学工程 生物医学工程
- 计算语言学 计算语言学
背景情况:
- 语音脑电脑接口 (BCI) 对于恢复因ALS或中风等疾病而导致无关节的患者的沟通至关重要.
- 现有的语音解码研究主要集中在英语上,面临着像普通话中文这样的音调,单音节语言的挑战.
研究的目的:
- 开发和评估一个实时的普通话中文语音BCI,能够从神经信号直接解码单音节单元.
- 解决目前对音色语言的语音驱动方法的局限性.
主要方法:
- 使用了256通道的微电皮质图 (ECoG) BCI系统.
- 开发了普通话中文的直接音节神经解码架构.
- 在单个字符阅读任务中测试了系统.
主要成果:
- 从神经信号直接实现了394个不同的普通话音节的强大解码.
- 在单个字符的阅读任务中显示了71.2%的中位音节识别准确度.
- 成功实现了利用音节解码器实现实时句子解码.
结论:
- 开发的音调集成,直接音节神经解码方法对普通话中文有效.
- 这种BCI系统对恢复音调单音节语言使用者的沟通非常有希望.
- 在具有类似结构的语言中为全面的通信系统铺平了道路.
相关概念视频
Design Example
698
The innovation of touch-tone telephony revolutionized the telecommunications industry by replacing the traditional rotary dial with a dual-tone multi-frequency (DTMF) signaling system. This system uses a matrix-style keypad with buttons arranged in four rows and three columns, creating 12 distinct signals each assigned to a pair of frequencies. Each button press results in a simultaneous generation of two sinusoidal tones – one from a low-frequency group (697 to 941 Hz) and one from a...
698
Continuous -time Fourier Transform
1.3K
The Fourier series is instrumental in representing periodic functions, offering a powerful method to decompose such functions into a sum of sinusoids. This technique, however, necessitates modification when applied to nonperiodic functions. Consider a pulse-train waveform consisting of a series of rectangular pulses. When these pulses have a finite period, they can be accurately represented by a Fourier series. Yet, as the period approaches infinity, resulting in a single, isolated pulse, the...
1.3K
Discrete-time Fourier transform
1.5K
The Discrete-Time Fourier Transform (DTFT) is an essential mathematical tool for analyzing discrete-time signals, converting them from the time domain to the frequency domain. This transformation allows for examining the frequency components of discrete signals, providing insights into their spectral characteristics. In the DTFT, the continuous integral used in the continuous-time Fourier transform is replaced by a summation to accommodate the discrete nature of the signal.
One of the notable...
One of the notable...
1.5K
Fast Fourier Transform
1.3K
The Fast Fourier Transform (FFT) is a computational algorithm designed to compute the Discrete Fourier Transform (DFT) efficiently. By breaking down the calculations into smaller, manageable sections, the FFT significantly reduces the computational complexity involved. Direct computation of an N-point DFT requires N2 complex multiplications, whereas the FFT algorithm needs only (N/2)log2N multiplications, offering a much faster performance.
The computational efficiency of the FFT becomes...
The computational efficiency of the FFT becomes...
1.3K
Aliasing
945
Accurate signal sampling and reconstruction are crucial in various signal-processing applications. A time-domain signal's spectrum can be revealed using its Fourier transform. When this signal is sampled at a specific frequency, it results in multiple scaled replicas of the original spectrum in the frequency domain. The spacing of these replicas is determined by the sampling frequency.
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
945
Time and frequency -Domain Interpretation of Phase-lag Control
472
Phase-lag controllers are widely used in control systems to improve stability and reduce steady-state errors. A dimmer switch controlling the brightness of a light bulb serves as a practical example of phase-lag control, gradually adjusting the bulb's brightness. Mathematically, phase-lag control or low-pass filtering is represented when the factor 'a' is less than 1.
Phase-lag controllers do not place a pole at zero, but instead influence the steady-state error by amplifying any...
Phase-lag controllers do not place a pole at zero, but instead influence the steady-state error by amplifying any...
472


