一个新的功能融合网络用于从EEG和眼睛运动信号的多式情绪识别
Baole Fu1,2, Chunrui Gu1,2, Ming Fu1,2
1School of Automation, Qingdao University, Qingdao, China.
Frontiers in neuroscience
|August 21, 2023
概括
这项研究引入了一种新型的多式特征融合神经网络 (MFFNN),用于增强情绪识别. 该MFFNN有效地融合了脑电图 (EEG) 和眼睛运动信号,在识别情绪状态方面实现了高精度.
科学领域:
- 神经科学是一个神经科学.
- 计算机科学 计算机科学
- 人工智能的人工智能
背景情况:
- 情感识别是复杂的,多式联络融合正在成为一个关键趋势.
- 融合向量提供了情绪状态的全面表示,提高了识别准确性.
- 核聚变投入和方法的选择显著影响了结果.
研究的目的:
- 提出一种用于情感识别的多模式特征融合神经网络 (MFFNN).
- 从脑电图 (EEG) 和眼睛运动信号中有效提取和融合互补信息.
- 为了提高情绪识别系统的准确性和稳定性.
主要方法:
- 一个双分支特征提取模块被设计用于EEG和眼动信号的时间对齐.
- 使用了采用跨通道软注意力的多尺度特征融合模块.
- 在SEED-IV数据集上进行了实验,以评估MFFNN模型.
主要成果:
- 在识别四种不同的情绪方面,MFFNN模型实现了87.32%的准确性.
- 该模型证明了EEG和眼动信号之间的互补信息的有效探索.
- 观察到情绪识别的准确性和稳定性得到改善.
结论:
- 拟议的MFFNN模型通过有效地融合EEG和眼动数据,显著提高了情绪识别.
- 多尺度融合方法与柔软的注意力适应性地选择相关特征.
- 这项研究有助于更强大,更准确的多式联络情绪识别系统.
相关概念视频
Association Areas of the Cortex
5.5K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.5K
Labeling Emotion
172
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
172


