MSER:一种基于多信号信息融合的情感识别方法
Lanai Huang1,2, Yong Zhang3, Sen Qiu2
1School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai, 200240 China.
Health information science and systems
|March 9, 2026
概括
这项研究引入了多信号情绪识别 (MSER) 和MSER注意力 (MSER-Att) 以使用生理信号更准确地识别情绪. MSER-Att的准确度达到95.41%,大大提高了传统方法的准确度.
科学领域:
- * 情感计算和人与计算机的互动.
- * 生物医学信号处理和机器学习.
背景情况:
- * 传统的情感识别依赖于主观的线索,如面部表情,经常错过关键的生理数据.
- * 整合生理信号对于克服传统主观情绪识别方法的局限性至关重要.
研究的目的:
- * 提出和评估多信号情绪识别 (MSER) 和其基于注意力的变体 (MSER-Att),以增强基于生理学的情绪识别.
- * 解决应用VGG网络和Ranger优化器用于多信号情绪识别的差距.
主要方法:
- *使用VGG网络架构和Ranger优化器开发MSER和MSER-Att模型.
- * 在MSER-Att中整合了注意力机制,以改进特征提取.
- *通过结合WESAD数据集中的四个生理信号来创建一个新的数据集,用于培训和验证.
- * 优化使用Ranger的培训过程,提前停止和十倍交叉验证.
主要成果:
- *MSER-Att实现了95.41%的高精度和98.54%的F1得分.
- * 个人情感分类显示精度 (PPV) 和真实阳性率 (TPR) 超过96%,有些达到100%.
- * 提出的方法优于现有的情绪识别技术.
结论:
- *通过将各种生理信号与注意力机制和VGG网络相结合,可显著增强多信号情绪识别系统.
- *MSER-Att模型为客观情绪状态识别提供了强大而准确的方法.
更多相关视频
相关概念视频
Motional Emf
Magnetic flux depends on three factors: the strength of the magnetic field, the area through which the field lines pass, and the field's orientation with respect to the surface area. If any of these quantities vary, a corresponding variation in magnetic flux occurs. If the area through which the magnetic field lines are passing changes, then the magnetic flux also changes. This change in the area can be of two types: the flux through the rectangular loop increases as it moves into the magnetic...
Classification of Signals
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Multi-input and Multi-variable systems
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
Physiology of Emotion
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Labeling Emotion
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...


