对象场景语义对图像情感分类的相关性分析
Zibo Zhou1, Zhengjun Zhai1, Huimin Chen1
1Northwestern Polytechnical University, Xi'an, China.
Frontiers in neuroscience
|September 26, 2025
概括
本研究介绍了对象场景注意力融合网络 (OSAFN) 用于图像情感分类. 通过融合对象和场景信息,OSAFN有效地弥合了情感差距,显著提高了情感识别的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 心理学 心理学 心理学
背景情况:
- 图像情感分类 (IEC) 从图像中预测人类的情感,这个领域受到视觉像素和高级情感感知之间的"情感差距"的挑战.
- 现有的IEC方法经常因语义表示的局限性而扎,阻碍了准确的情感预测.
研究的目的:
- 通过提出一个新的网络来解决IEC中的情感差距,即对象-场景注意力融合网络 (OSAFN).
- 通过整合对象级概念和场景级推理作为辅助信息来增强情绪分类.
主要方法:
- OSAFN使用外部工具进行概念提取和基于评估的思维链 (Appraisal-CoT) 提示以生成场景信息.
- 基于注意力的模块对齐语义和视觉特征,而自适应的融合策略集成了对象和场景流.
- 一个极性意识的对比损失被用来建模情感层次结构,并改善细粒度的类别歧视.
主要成果:
- 在四个情感数据集上的数值实验表明了OSAFN.的优越性能.
- 拟议的方法有效地利用对象和场景信息,以增强视觉表示和情感分类.
结论:
- OSAFN代表了对图像情感分类领域的显著贡献.
- 对象和场景语义信息的融合有效地减轻了情感差距,从而改善了模型性能.
相关概念视频
Labeling Emotion
601
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
601
Cognitive Theories: Schachter-Singer Theory of Emotion
1.5K
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
1.5K
Physiology of Emotion
3.2K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
3.2K
Physiological Theories: James-Lange Theory of Emotion
2.0K
The James-Lange theory of emotion, proposed by William James and Carl Lange in the late 19th century, asserts that emotions are the result of physiological reactions to external stimuli. Contrary to the traditional view, which suggests that emotions directly arise from the perception of stimuli, this theory proposes that emotions occur as a consequence of the body's responses to such stimuli. According to this framework, an emotional experience is a cognitive interpretation of physiological...
2.0K
Emotional Expression
954
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
954
Cognitive Theories: Lazarus Mediational Theory of Emotion
2.0K
Richard Lazarus' cognitive mediational theory highlights the pivotal role of cognitive appraisal in shaping emotional responses. According to this theory, the evaluation of a stimulus — based on personal values, goals, beliefs, and expectations — mediates the emotional response. This appraisal process is immediate and often occurs unconsciously, influencing the intensity and nature of the resulting emotion.
Cognitive Appraisal and Emotional Response
Lazarus proposed that...
Cognitive Appraisal and Emotional Response
Lazarus proposed that...
2.0K


