E-MFNN:一种情绪-多模式融合神经网络框架,用于情绪识别
Zhuen Guo1, Mingqing Yang1, Li Lin1
1School of Mechanical Engineering, Guizhou University, Guiyang, Guizhou, China.
PeerJ. Computer science
|April 25, 2024
概括
这项研究引入了情感识别的新多式模式框架,将刺激数据与生理信号 (如脑电图 (EEG) 和眼睛跟踪 (ET) 等) 整合起来,以提高准确性.
科学领域:
- 计算机科学 计算机科学
- 认知科学 认知科学
- 情感计算是一种情感计算.
背景情况:
- 情绪识别在计算机和认知科学中至关重要.
- 现有的方法利用各种数据来源,如语音,面部表情,EEG和ET.
- 情绪刺激的作用与用户的反应同样重要.
研究的目的:
- 开发一种用于情绪识别的新型多式联络框架.
- 将刺激数据与生理信号相结合,以提高准确性和稳定性.
- 分析用户的心理反应和引发它们的刺激.
主要方法:
- 一种多式模式的方法,将刺激数据与物理和生理信号进行协同.
- 一个情感认知实验收集EEG和ET数据.
- 发展情感多模式融合神经网络 (E-MFNN) 用于数据融合.
主要成果:
- E-MFNN框架有效地处理刺激和生理数据.
- 广泛的比较证明了框架对现有模型的有效性.
- 评估了框架内的算法变化,强调了它的稳定性.
结论:
- 拟议的多式联络框架显著增强了情绪识别.
- 整合刺激和生理数据是准确情绪认知的关键.
- E-MFNN为多式联动情绪识别提供了强大而有效的解决方案.
相关概念视频
Association Areas of the Cortex
5.3K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.3K
Facial Feedback Hypothesis
147
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
147
Functional Brain Systems: Limbic System
2.6K
The limbic system, often called the "emotional brain," is a complex set of structures located deep within the brain. The intricate network of the limbic system supports a wide range of psychological functions, from emotional regulation to memory formation and sensory processing. This functional brain region encompasses specific parts of the diencephalon and the cerebrum, integrating the higher mental functions of the cerebral cortex with the primitive emotional responses of the deep brain...
2.6K


