基于即时学习的对话中的多模态情绪识别,具有文本-音频融合功能
Yuezhou Wu1, Siling Zhang2, Pengfei Li2
1School of Computer Science, Civil Aviation Flight University of China, Guanghan, 618307, China. wuyuezhou@cafuc.edu.cn.
Scientific reports
|March 15, 2025
概括
这项研究介绍了MERC-PLTAF,这是一种用于对话中情绪识别 (ERC) 的新型多式联络方法. 该方法有效地克服了语言障碍,大大提高了英语和中文数据集的跨语言ERC准确性.
科学领域:
- 人工智能的人工智能
- 自然语言处理自然语言处理.
- 人与计算机的交互
背景情况:
- 交互式机器应用越来越多,推动了对先进的对话情绪识别 (ERC) 技术的需求.
- 目前的ERC方法面临语言障碍和有限的非英语数据,这阻碍了跨语言应用.
- 现有的方法通常依赖于单一的模式,限制了全面的情感理解.
研究的目的:
- 开发一种创新的多式联络式对话情绪识别 (MERC-PLTAF) 方法.
- 解决目前ERC技术中单一模式和语言障碍的局限性.
- 为了增强跨语言情绪识别能力.
主要方法:
- 提出了MERC-PLTAF方法,专注于多式联络式情绪识别.
- 采用精细的特征提取技术.
- 利用复杂的交叉融合策略来整合多式联运信息.
主要成果:
- 在多个英语和中文数据集中,表现出了情绪识别准确度的显著改善.
- 在中国M3ED数据集上取得了卓越的表现,展示了跨语言的有效性.
- 验证了MERC-PLTAF方法对现有方法的优越性.
结论:
- MERC-PLTAF方法为有效的跨语言情绪识别提供了一个新的途径.
- 这项研究推进了ERC技术,并为更智能的人机交互提供了框架.
- 这些发现支持通过更好的情感理解来开发更多以人为中心的互动体验.
相关概念视频
Labeling Emotion
82
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
82
Therapeutic Communication
4.1K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
4.1K
Motional Emf
3.1K
Magnetic flux depends on three factors: the strength of the magnetic field, the area through which the field lines pass, and the field's orientation with respect to the surface area. If any of these quantities vary, a corresponding variation in magnetic flux occurs. If the area through which the magnetic field lines are passing changes, then the magnetic flux also changes. This change in the area can be of two types: the flux through the rectangular loop increases as it moves into the...
3.1K
Emotional Expression
136
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
136
Empathy
9.5K
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor.
9.5K
Introduction to Motivation and Emotion
275
Motivation is a multifaceted process that drives behavior toward fulfilling various physiological or psychological needs. This process involves initiating, guiding, and maintaining specific actions influenced by internal and external factors. For example, when someone feels hungry while watching television, hunger is a motivator, prompting the individual to get up, walk to the kitchen, and find something to eat. In this instance, hunger initiates and sustains the behavior necessary to meet the...
275


