情感感知 RoBERTa 增强了情感特定的注意力和TF-IDF门,用于精细的情感识别
Fatimah Alqarni1, Alaa Sagheer2, Amira Alabbad1
1Department of Computer Science, College of Computer Sciences and Information Technology, King Faisal University, Hofuf, Saudi Arabia.
Scientific reports
|May 21, 2025
概括
情感感知 RoBERTa 通过优先考虑突出的令牌来增强文本情感识别,达到96.77%的准确性. 这种强大的自然语言处理模型改进了现有的现实世界应用方法.
科学领域:
- 自然语言处理 (NLP) 是一种自然语言处理.
- 人工智能 (AI) 是一种人工智能.
- 计算语言学 计算语言学
背景情况:
- 像RoBERTa这样的变压器模型在上下文理解方面表现出色,但与微妙的情绪,杂的数据和阶级不平衡作斗争.
- 准确的情绪识别对于情绪分析,心理健康监测和内容调节等应用至关重要.
研究的目的:
- 介绍Emotion-Aware RoBERTa,这是一个改进的框架,用于改进文本中细粒度的情感识别.
- 解决现有模型在处理微妙的情感线索和噪音输入方面的局限性.
主要方法:
- 将情感特定注意 (ESA) 层和基于TF-IDF的门机制集成到RoBERTa架构中.
- 动态优先考虑情感突出的代币,并抑制不相关的内容.
- 使用注意力热图进行可视化和FP16/AMP进行推理优化.
主要成果:
- 在主要数据集上获得了96.77%的准确性和0.97加权F1分数,表现优于基线RoBERTa,DistilBERT和ALBERT.
- 在外部数据集中展示了概括性 (88.03%在大规模,65.67%在杂).
- 废弃研究证实了ESA和TF-IDF组件的协同作用,平衡性能和效率.
结论:
- 情感感知 RoBERTa 为情感识别提供了一个可扩展,可解释和易于部署的解决方案.
- 该模型显著提高了准确性和稳定性,使其适用于现实世界,情感感知NLP系统.
- 麦克内马尔的测试证实了性能改进对基线模型的统计学意义.
相关概念视频
01:20Labeling Emotion
82
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
82
01:20Cognitive Theories: Schachter-Singer Theory of Emotion
205
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
205
01:26Emotional Expression
136
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
136
01:21Association Areas of the Cortex
4.8K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
4.8K
01:24Facial Feedback Hypothesis
108
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
108
02:34Empathy
9.5K
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor.
9.5K