乌梅德网:乌尔都语情感检测的多模式方法
1School of Computing, National University of Computer and Emerging Sciences, Islamabad, Islamabad, Punjab, Pakistan.
PeerJ. Computer science
|June 26, 2025
概括
本研究介绍了乌尔都语多式联动情绪检测网络 (UMEDNet) 以及使用视频,语音和文本检测乌尔都语情绪的新体. UMEDNet模型实现了85.27%的准确性,为低资源语言推进了情感计算.
科学领域:
- 情感计算是一种情感计算.
- 人与计算机的互动.
- 自然语言处理自然语言处理.
背景情况:
- 情绪检测对于人机交互,情感计算和健康查至关重要.
- 综合视频,语音和文本的多式联络方法可以增强情绪识别.
- 像乌尔都语这样的低资源语言缺乏情绪检测的系统模型.
研究的目的:
- 为乌尔都语情绪检测提出乌尔都语多模式情绪检测网络 (UMEDNet).
- 介绍乌尔都语多式情绪检测 (UMED) 库,这是乌尔都语多式情绪分析的新资源.
- 为解决低资源语言情感检测研究的差距.
主要方法:
- 开发了UMEDNet,这是一个利用视频,语音和文本输入的多式联网.
- 创建了UMED集体:乌尔都语中五种基本情绪的17小时注释数据集.
- 使用了最先进的功能提取:MTCNN/FaceNet (视频),Wav2Vec2 (语音),XLM-Roberta (文本).
主要成果:
- 在UMED库中,UMEDNet的整体准确率达到85.27%.
- 精度,回忆和F1分数始终很高,在所有指标上大致相当.
- 在共同的潜伏空间中的特征融合有效地提高了多式联络情绪预测的准确性.
结论:
- 乌梅德网在乌尔都语情感检测方面表现出强的表现,验证了多式联络方法.
- UMED集体是未来研究低资源多式联络情绪分析的基础资源.
- 与单模方法相比,整合多模数据显著提高了情绪检测准确度.
相关概念视频
Labeling Emotion
253
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
253
Emotional Expression
387
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
387
Facial Feedback Hypothesis
253
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
253
Physiology of Emotion
1.5K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
1.5K


