TSFNet:用于混合脑计算机接口的时空融合网络
Yan Zhang1, Bo Yin1, Xiaoyang Yuan1
1School of Electrical Engineering and Automation, Harbin Institute of Technology, Harbin 150001, China.
Sensors (Basel, Switzerland)
|October 16, 2025
概括
这项研究引入了一种新的时空融合网络 (TSFNet),用于混合脑电脑接口 (BCI),有效地集成脑电图 (EEG) 和功能近红外光谱 (fNIRS) 信号. TSFNet显著提高了运动图像,心理算术和文字生成任务的分类准确性.
科学领域:
- 神经科学是一个神经科学.
- 生物医学工程 生物医学工程
- 信号处理 信号处理
背景情况:
- 单模脑机接口 (BCI) 由于单模限制而面临限制.
- 混合BCI结合了脑电图 (EEG) 和功能近红外光谱 (fNIRS) 提供了互补的数据,但由于信号异步,与时空特征集成扎.
研究的目的:
- 开发一个新的深度融合网络,以协同集成EEG和fNIRS信号.
- 在跨多种任务的混合BCI中提高分类性能.
主要方法:
- 提出了一个时空融合网络 (TSFNet),采用EEG-fNIRS引导的融合 (EFGF) 和基于交叉注意力的特征增强 (CAFÉ) 层.
- 为了整合注意力映射,EGF层提取时间 (EEG) 和空间 (fNIRS) 特征.
- 咖啡层使用交叉注意力进行双向交互,增强融合和过fNIRS数据.
主要成果:
- 在运动图像 (MI),心理算术 (MA) 和文字生成 (WG) 任务中,TSFNet实现了优异的分类性能.
- 平均准确率为MI达到70.18%,MA为86.26%,WG为81.13%.
- 在分类准确性方面表现优于现有的最先进的多式联运算法.
结论:
- 在混合BCI中,TSFNet提供了一种有效的解决方案,以深度融合多式模式的时空特征.
- 拟议的网络显示了现实世界BCI应用的巨大潜力.
- 通过TSFNet实现EEG和fNIRS的协同集成,克服了单模式和更简单的多模式方法的局限性.
相关概念视频
Network Covalent Solids
Network covalent solids contain a three-dimensional network of covalently bonded atoms as found in the crystal structures of nonmetals like diamond, graphite, silicon, and some covalent compounds, such as silicon dioxide (sand) and silicon carbide (carborundum, the abrasive on sandpaper). Many minerals have networks of covalent bonds.
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
Network Function of a Circuit
Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.
State Space Representation
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
State Space to Transfer Function
The conversion of state-space representation to a transfer function is a fundamental process in system analysis. It provides a method for transitioning from a time-domain description to a frequency-domain representation, which is crucial for simplifying the analysis and design of control systems.
The transformation process begins with the state-space representation, characterized by the state equation and the output equation. These equations are typically represented as:
The transformation process begins with the state-space representation, characterized by the state equation and the output equation. These equations are typically represented as:


