M3T-attention:EEGによる手の動きの軌跡デコーディングのためのマルチレベル・マルチスケール時間的アテンショントランスフォーマー
Lei Zhu1, Peng Jiang1, Aiai Huang1
1School of Automation, Hangzhou Dianzi University, Hangzhou, People's Republic of China.
Abstract:
In recent years, brain-computer interface (BCI) technology has made significant progress in the fields of neural engineering and human-computer interaction. Among these advances, decoding upper-limb movements from electroencephalography (EEG) signals has become a key research focus. However, most existing studies concentrate on discrete classification tasks (e.g., motor imagery recognition), while the prediction of three-dimensional continuous movement trajectories still faces several major challenges. These include the low signal-to-noise ratio of EEG signals, substantial inter-subject variability that limits generalizability, and the high degrees of freedom in 3D trajectories, which increase decoding complexity. To address these challenges and improve the accuracy of decoding continuous 3D hand movement trajectories from EEG signals, this study proposes a Multi-level Multi-scale Temporal Attention Transformer framework (M3T-Attention). The model is designed to extract temporal features across multiple time scales from EEG signals and integrate them via cross-scale attention mechanisms, enabling a nonlinear mapping from 0.5 to 12 Hz EEG signals to 3D kinematic parameters (position, velocity, and acceleration). The model was trained using EEG and wrist kinematic data from the WAY-EEG-GAL dataset. Experimental results show that the proposed method achieves Pearson correlation coefficients (PCCs) of 0.8816, 0.8841, and 0.8711 on the X, Y, and Z axes, respectively, demonstrating robust prediction performance across all subjects and outperforming existing state-of-the-art approaches. In summary, through comparative experiments, statistical significance analysis, and ablation studies, we have fully verified its ability to capture neural coding patterns. It significantly enhances the decoding performance from EEG signals to movement trajectories, offering new approaches for BCI applications in complex motor control scenarios. We have made the model's source code publicly available on GitHub repository URL: https://github.com/jjspp/M3T_Attention.
関連する概念動画
Attention-Deficit/Hyperactivity Disorder
Diagnostic Criteria and Symptoms
To diagnose ADHD, symptoms must manifest before age 12 and be evident across multiple settings....
Multi-input and Multi-variable systems
In the absence of...
Multi-Step Reactions
Multi-species Conserved Sequences
Although the genome of each species varies greatly from each other, a few sequences are highly conserved. Such conserved...
Orthogonal Trajectories
Insertion of Multi-pass Transmembrane Proteins in the RER
The multipass transmembrane proteins are the type IV integral membrane proteins with multiple topogenic sequences determining their spatial arrangement in the ER membrane. Nearly all multipass proteins lack a cleavable signal sequence and use...


