一个新的信号通道注意力网络,用于多式联络式情绪识别
Ziang Du1, Xia Ye1, Pujie Zhao1
1Xi'an Research Institute of High-Tech, Xi'an, Shaanxi, China.
Frontiers in neurorobotics
|September 26, 2024
概括
本研究介绍了信号通道注意网络 (SCA-Net),用于通过生理信号增强情绪识别. 通过新的注意力机制和多模式融合,SCA-Net提高了分类准确性和F1分数.
科学领域:
- 情感计算是一种情感计算.
- 生物医学信号处理
背景情况:
- 生理信号识别是情绪识别的关键.
- 目前的多模融合模型由于融合方法和注意力机制而难以处理复杂的信号,从而限制了性能.
研究的目的:
- 提出一个新的模型,信号通道注意网络 (SCA-Net),以克服多式联络式情绪识别方面的局限性.
- 通过开发和整合有效的注意力机制来提高分类性能.
主要方法:
- 开发了带有编码器,注意力融合模块和解码器的SCA-Net.
- 在融合模块中引入了五种新的注意力机制.
- 在MAHNOB-HCI数据集上进行了比较和废弃实验.
主要成果:
- 与基线模型相比,注意力机制显著提高了准确性和F1得分.
- 废弃实验证实了多模式融合的好处.
- 调整了早期停止参数,以防止过.
结论:
- 拟议的SCA-Net有效地增强了从生理信号的情绪识别.
- 注意力机制和多模式融合对于改善复杂情感计算任务中的分类性能至关重要.
更多相关视频
05:51Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
Published on: May 15, 2016
9.0K
11:14A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
Published on: October 4, 2015
10.9K
相关概念视频
Emotional Expression
189
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
189
Cognitive Theories: Schachter-Singer Theory of Emotion
315
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
315
Labeling Emotion
116
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
116
Facial Feedback Hypothesis
135
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
135
