EMPT:用于基于EEG的运动图像识别的稀疏性变压器
Ming Liu1, Yanbing Liu1, Weiyou Shi1
1International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, Shandong, China.
Frontiers in neuroscience
|May 9, 2024
概括
这项研究引入了一种新的深度学习模型,即EMPT,用于解码脊髓损伤患者的脑电图 (EEG) 信号,这些患者接受运动图像任务. 通过结合专家混合和ProbSparse自我注意力,EMPT实现了高精度,使EEG分析更有效.
科学领域:
- 神经科学是一个神经科学.
- 人工智能的人工智能
- 生物医学工程 生物医学工程
背景情况:
- 变压器网络在信号处理方面表现出色,但需要大量数据和复杂的算法来进行脑电图 (EEG) 分析.
- 自我注意机制对于EEG特征编码是有效的,但面临数据量和算法复杂性的局限性.
研究的目的:
- 开发一种高效的深度学习模型来解码脊髓损伤患者的运动图像 (MI) EEG信号.
- 在EEG分析中解决变压器网络的数据和复杂性挑战.
主要方法:
- 开发了一种新的EEG MoE-Prob-Transformer (EMPT) 模型,集成了专家混合 (MoE) 和ProbSparse自我注意机制.
- 使用共同的空间模式和修改的s变换提取了时间频空间特征,作为EMPT模型的输入嵌入.
- 能源部层引入了稀疏性,用于增强特征重建和分析.
主要成果:
- 在脊髓损伤患者的运动图像EEG数据集上,EMPT模型实现了95.24%的高精度.
- 在比较实验中,EMPT与现有最先进的方法相比,表现优越.
结论:
- 整合MoE层和ProbSparse自我注意,通过引入稀疏性,提高了变压器网络对EEG数据集的适用性.
- EMPT提出了一种新且有效的深度学习方法,用于解码运动图像任务中的EEG数据,特别是对于SCI患者.
相关概念视频
Receptor-mediated Endocytosis
Overview
Smooth Endoplasmic Reticulum
Smooth endoplasmic reticulum or smooth ER is a sub-organelle with specialized functions in animal cells and plant cells. It is often associated with the tubule morphology of the endoplasmic reticulum.
The ER provides optimal conditions for synthesizing steroid hormones and lipids, such as phospholipids and triglycerides. Traditionally, lipid metabolism was considered to be a smooth ER function. However, there is no direct evidence to prove that rough ER is completely excluded from lipid...
The ER provides optimal conditions for synthesizing steroid hormones and lipids, such as phospholipids and triglycerides. Traditionally, lipid metabolism was considered to be a smooth ER function. However, there is no direct evidence to prove that rough ER is completely excluded from lipid...
Liver Regeneration
The liver is an important organ in vertebrates that plays an essential role in metabolism. It is also responsible for storing and redistributing nutrients such as carbohydrates, fats, and vitamins in the body. Additionally, the liver releases bile salts which are critical for digesting food and eliminating toxic metabolites from the body.
Cells of Liver
The liver comprises four major types of cells— hepatocytes, stellate, Kupffer, and sinusoidal endothelial cells. The hepatocytes are large...
Cells of Liver
The liver comprises four major types of cells— hepatocytes, stellate, Kupffer, and sinusoidal endothelial cells. The hepatocytes are large...
Liver Histology
The microscopic anatomy of the liver is a complex and intricate system that comprises numerous structural units known as liver lobules, each of which is comparable in size to a sesame seed. These hexagonal structures consist of plates of liver cells or hepatocytes, which are characterized by their versatility and abundance of cellular apparatus like rough and smooth ER, Golgi apparatus, peroxisomes, and mitochondria.
Hepatocytes perform a variety of essential functions. They secrete...
Hepatocytes perform a variety of essential functions. They secrete...
Lipid Absorption
Dietary triglycerides from chyme in the duodenum are mixed with bile salts produced by the liver to emulsify fats. As a result, large droplets are broken down into smaller ones, increasing the surface area for enzymatic action. Once emulsified, pancreatic lipases hydrolyze the triglycerides into free fatty acids and monoglycerides.
These breakdown products bind with bile salts and lecithin to form micelles, which quickly pass between microvilli to come in close contact with the apical...
These breakdown products bind with bile salts and lecithin to form micelles, which quickly pass between microvilli to come in close contact with the apical...
Lipid Catabolism
Triglycerides serve as crucial long-term energy storage molecules in microorganisms, providing a dense source of metabolic energy. Their breakdown is mediated by lipases, which hydrolyze triglycerides into glycerol and free fatty acids. Each of these components follows distinct metabolic pathways, ultimately contributing to ATP synthesis and cellular energy homeostasis.Glycerol MetabolismGlycerol, released from triglyceride hydrolysis, is phosphorylated by glycerol kinase to form...


