行为和生理信号的多模式融合,通过特征解和知识转移来增强情绪识别
IEEE journal of biomedical and health informatics
|August 11, 2025
概括
这项研究引入了多模式情绪识别的新框架,解开了生理和行为信号中共享和独特的特征. 该方法增强了跨模式的知识传输,在情感理解方面取得了最先进的结果.
科学领域:
- 情感计算是一种情感计算.
- 人与计算机的互动.
- 机器学习是机器学习.
背景情况:
- 多模式情绪识别整合了生理和行为信号,以理解复杂的人类情绪状态.
- 现有的方法面临特征冗余性,模式异质性和有限的跨模式监督方面的挑战.
研究的目的:
- 为增强情感识别提出一个新的多式联络解知识蒸框架.
- 为了明确地解开模式共享和模式特定的特征.
- 通过基于图形的蒸模块来改进跨模式的知识传输.
主要方法:
- 双流表示学习架构将通用和独特的特征子空间在模式之间分开.
- 一个有针对性和可学习的模式图表模拟了模式之间的语义传输强度.
- 该框架在MAHNOB-HCI和DEAP数据集上进行了验证,用于回归和分类任务.
主要成果:
- 拟议的方法在基准数据集上实现了最先进的性能.
- 统计学意义得到了证实,使用配对的双尾t测试.
- 定性分析证明了特征解和动态知识转移的有效性.
结论:
- 该框架提供了一种统一,可解释和强大的方法来理解多式联络情绪.
- 这项工作为现实世界的人机交互场景推进了情感计算.
- 该方法有效地解决了多式联动情绪识别中的特征冗余性和模式异质性.
相关概念视频
Physiology of Emotion
1.4K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
1.4K
Labeling Emotion
237
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
237
Cognitive Theories: Schachter-Singer Theory of Emotion
589
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
589
Cognitive Theories: Lazarus Mediational Theory of Emotion
1.2K
Richard Lazarus' cognitive mediational theory highlights the pivotal role of cognitive appraisal in shaping emotional responses. According to this theory, the evaluation of a stimulus — based on personal values, goals, beliefs, and expectations — mediates the emotional response. This appraisal process is immediate and often occurs unconsciously, influencing the intensity and nature of the resulting emotion.
Cognitive Appraisal and Emotional Response
Lazarus proposed that...
Cognitive Appraisal and Emotional Response
Lazarus proposed that...
1.2K
Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
Physiological Theories: James-Lange Theory of Emotion
909
The James-Lange theory of emotion, proposed by William James and Carl Lange in the late 19th century, asserts that emotions are the result of physiological reactions to external stimuli. Contrary to the traditional view, which suggests that emotions directly arise from the perception of stimuli, this theory proposes that emotions occur as a consequence of the body's responses to such stimuli. According to this framework, an emotional experience is a cognitive interpretation of physiological...
909


