通过双谱特征和影响动态来探索同行对话中的情绪气候识别
Ghada Alhussein1, Mohanad Alkhodari2, Ioannis Ziogas1
1Department of Biomedical Engineering and Biotechnology, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.
Computer methods and programs in biomedicine
|March 26, 2025
概括
这项研究介绍了MLBispec,这是一种新的AI方法,用于在使用语音信号的对话中识别情绪气候 (EC). MLBispec实现了高精度,超越现有方法,并使更多情感意识的应用程序成为可能.
科学领域:
- 人工智能的人工智能
- 情感计算是一种情感计算.
- 人与计算机的交互
背景情况:
- 在对话中识别情绪对于理解社会行为至关重要.
- 情绪气候 (EC) 代表了对话中的共享情绪氛围.
- 现有的人工智能方法主要关注个人情绪,而不是集体气候.
研究的目的:
- 提出和评估MLBispec,一种用于在对话中识别情绪气候 (EC) 的新方法.
- 使用语音信号进行动态EC评估.
- 增强AI在理解细微对话动态方面的能力.
主要方法:
- 采用语音信号的时间窗口双光谱分析,用于非线性波特征提取.
- 集成的提取特征与同行影响对扩展特征集的动态.
- 使用机器学习分类器,并根据IEMOCAP,K-EmoCon和SEWA数据集进行评估.
主要成果:
- MLBispec实现了最先进的准确性:82.6%的兴奋和75.4%的价值.
- 这种方法有效地表征了对话情感结构的动态语音表示.
- 跨语言实验证实了MLBspec框架的稳定性和通用性.
结论:
- MLBispec在客观地识别同行在对话中的情绪气候方面表现出有效性.
- 这些发现为实际的情感意识应用建立了新的基准.
- 这项研究推进了医疗保健,HCI和大语言模型的情感智能系统.
相关概念视频
Factors Affecting Perception
1.4K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
1.4K
Labeling Emotion
78
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
78
Facial Feedback Hypothesis
107
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
107
Cognitive Theories: Schachter-Singer Theory of Emotion
196
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
196
Emotional Expression
131
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
131
Empathy
9.5K
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor.
9.5K


