不确定性意识图表对比融合网络用于多式生理信号的多式生理信号情绪识别
Guangqiang Li1, Ning Chen1, Hongqing Zhu1
1School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China.
概括
这项研究引入了一个不确定性意识图对比融合网络 (UAGCFNet),用于使用生理信号识别情绪. 这种新的方法通过解决传感器间连接的不确定性,有效地融合多式联网数据,优于现有方法.
科学领域:
- 多模式机器学习是多模式机器学习.
- 情感计算是一种情感计算.
- 信号处理 信号处理
背景情况:
- 图形神经网络 (GNN) 用于从生理信号识别情绪,但与非静止性和噪音作斗争.
- 现有的多模式融合模型不能充分解决传感器间连接的不确定性和由此产生的单模式偏差.
研究的目的:
- 提出一个不确定性感知图对比融合网络 (UAGCFNet),用于在情感识别中有效的多模式生理信号融合.
- 为了解决跨模态语义差距的不确定性和单模态偏差问题.
主要方法:
- 开发了一个不确定性意识图形卷积网络 (UAGCN) 来量化传感器间连接的不确定性,并提取不确定性意识图形表示.
- 设计了一个过渡对比融合 (TCF) 模块,集成危机交叉注意力 (CCA) 和过渡对比学习 (TCL) 以实现强大的多式联结.
主要成果:
- 在DEAP,DREAMER和MPED数据集上,UAGCFNet模型表现出优于最先进的多式联络融合模型 (SOTA) 的性能.
- 用更少的参数和更低的计算复杂度实现更好的结果.
- 有效地消除了先前方法固有的单模偏差问题.
结论:
- 拟议的UAGCFNet有效地融合了多模式的生理信号,以增强情绪识别.
- 不确定性意识图形卷积网络和过渡性对比融合模块对于性能增长至关重要.
- 该模型成功地减轻了单模式偏差,提高了聚变效率.
相关概念视频
01:20Physiology of Emotion
483
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
483
01:16Physiological Theories: James-Lange Theory of Emotion
325
The James-Lange theory of emotion, proposed by William James and Carl Lange in the late 19th century, asserts that emotions are the result of physiological reactions to external stimuli. Contrary to the traditional view, which suggests that emotions directly arise from the perception of stimuli, this theory proposes that emotions occur as a consequence of the body's responses to such stimuli. According to this framework, an emotional experience is a cognitive interpretation of physiological...
325
01:22Physiological Theories: Cannon-Bard Theory of Emotion
300
The Cannon-Bard theory of emotion, proposed by Walter Cannon and Philip Bard, challenges the notion that emotions are solely the result of physiological responses. Instead, this theory suggests that emotional experiences and physiological arousal occur simultaneously but operate through independent mechanisms. This dual response is initiated by the brain, specifically by the thalamus, which plays a critical role in processing sensory information.
Upon perceiving a stimulus, such as a dangerous...
Upon perceiving a stimulus, such as a dangerous...
300
01:30Classification of Signals
365
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
365
01:20Cognitive Theories: Schachter-Singer Theory of Emotion
201
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
201
01:22Multi-input and Multi-variable systems
93
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
93