SAWGAN-BDCMA:一种自我注意力瓦斯斯坦GAN和双向交叉模式注意力框架,用于多模式情绪识别
Ning Zhang1, Shiwei Su2, Haozhe Zhang2
1College of Electronic Information Engineering, Taiyuan University of Technology, Taiyuan 030024, China.
Sensors (Basel, Switzerland)
|January 28, 2026
概括
这项研究引入了一种新的情绪识别框架,使用诸如脑电图 (EEG) 和光电图 (PPG) 等生理信号来识别情绪. 先进的模型显著提高了从各种数据集分类情绪的准确性.
科学领域:
- 生理信号处理 物理信号处理
- 机器学习用于情感计算.
- 人与计算机的互动.
背景情况:
- 单模态情绪识别管道经常由于数据有限和不良的交叉模式融合而失败.
- 现有的方法与数据多样性和生理信号的分布不平衡作斗争.
- 准确的情感识别对于开发智能的人机交互系统至关重要.
研究的目的:
- 提出一个新的框架,SAWGAN-BDCMA,以克服单模式情感识别的局限性.
- 通过合成高质量的生理数据和改进交叉模式融合,提高情绪识别准确度.
- 在情绪识别任务中为数据稀缺和模式失衡提供强有力的解决方案.
主要方法:
- 开发了一个自我注意力瓦斯斯坦生成对抗网络 (SAWGAN) 来合成脑电图 (EEG) 和光电图 (PPG) 数据.
- 采用双分支架构来提取每个模式内的歧视性时空特征.
- 实施了双向交叉模态注意力 (BDCMA) 机制,用于多模态生理信号的适应性,双向融合.
主要成果:
- 在DEAP数据集上,SAWGAN-BDCMA框架实现了对二进制分类的94.25%准确率和对四进制分类的87.93%准确率.
- 在ECSMP数据集上,在六类情绪识别方面获得了97.49%的准确性.
- 与最先进的多式联络方法相比,显著提高了准确度 (0.57%至14.01%).
结论:
- 拟议的SAWGAN-BDCMA框架为情感识别挑战提供了强有力的解决方案,包括数据稀缺和模式不平衡.
- 这项工作为精细的情感识别奠定了坚实的理论和技术基础.
- 这些发现为通过增强的情感计算为更智能的人与计算机合作铺平了道路.
相关概念视频
Attention-Deficit/Hyperactivity Disorder
896
Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder characterized by persistent inattention, hyperactivity, and impulsivity. It affects approximately 5-8% of children globally, with around 60-70% of cases persisting into adulthood. ADHD has significant implications for educational attainment, social interactions, and occupational success.
Diagnostic Criteria and Symptoms
To diagnose ADHD, symptoms must manifest before age 12 and be evident across multiple settings....
Diagnostic Criteria and Symptoms
To diagnose ADHD, symptoms must manifest before age 12 and be evident across multiple settings....
896
Crossing Over
171.7K
Unlike mitosis, meiosis aims for genetic diversity in its creation of haploid gametes. Dividing germ cells first begin this process in prophase I, where each chromosome—replicated in S phase—is now composed of two sister chromatids (identical copies) joined centrally.
The homologous pairs of sister chromosomes—one from the maternal and one from the paternal genome—then begin to align alongside each other lengthwise, matching corresponding DNA positions in a process...
The homologous pairs of sister chromosomes—one from the maternal and one from the paternal genome—then begin to align alongside each other lengthwise, matching corresponding DNA positions in a process...
171.7K
Crossing Over
6.4K
Crossing over is the exchange of genetic information between homologous chromosomes during prophase I of meiosis I. Genetic recombination gives rise to allelic diversity in the newly formed daughter cells. In humans, crossing over produces genetically distinct haploid egg and sperm cells that undergo fertilization to produce unique offspring. Before cell division starts, the germ cell’s chromosome(s) undergo duplication in the S phase of the cell cycle. As the cells enter prophase I,...
6.4K
Sensory Modalities
3.9K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
3.9K
Physiology of Emotion
3.3K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
3.3K
Emotional Expression
1.0K
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
1.0K


