对于性别意识的高级差异进化英语语音情感识别认知
Liya Yue1, Pei Hu2, Jiulong Zhu3
1Fanli Business School, Nanyang Institute of Technology, Nanyang, 473004, China.
Scientific reports
|July 31, 2024
概括
这项研究介绍了一种基于性别的语音情感识别 (SER) 系统. 通过为男性和女性扬声器开发不同的模型,并通过先进的差异演化算法 (ADE) 优化功能,该系统显著提高了识别精度.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 信号处理 信号处理
背景情况:
- 语音情感识别 (SER) 系统因性别差异和众多提取的特征而面临挑战,影响识别效率.
- 现有的SER模型经常难以解释性别之间的语音模式变化,导致表现不佳.
- 从语音信号中提取的大量特征也可能导致识别精度降低和计算负载增加.
研究的目的:
- 开发一种新的SER系统,以解决性别特异性的语音变化,以提高情感识别准确度.
- 引入先进的差异演化算法 (ADE) 以在SER中进行最佳特征选择,提高模型性能.
- 研究性别特异性情感识别模型对整体系统有效性的影响.
主要方法:
- 设计了一个SER系统,结合了性别识别和情绪分类模型.
- 为男性和女性演讲者开发了不同的情感识别模型,性别识别先于情感分类.
- 一种先进的差异演化算法 (ADE),具有新的差异向量,突变运算符,位置学习和一种新的修复方法,用于最佳特征选择.
主要成果:
- 在四个英语数据集上的实验表明,拟议的ADE算法优于比较方法.
- 基于ADE的SER系统实现了更高的识别精度,回忆精度和F1分数.
- 该系统还在使用的功能数量和执行时间方面取得了改进,突出显示了其效率.
结论:
- 性别是完善语音情感识别模型的重要因素,性别特定的方法提高了表现.
- 提出的高级差异演化算法 (ADE) 有效地优化了SER的特征选择,平衡了全球和本地搜索.
- 梅尔频率塞普斯特尔系数 (MFCCs) 被确定为在语音情感识别中导致性别差异的重要因素.
更多相关视频
相关概念视频
01:26Emotional Expression
201
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
201
01:24Facial Feedback Hypothesis
135
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
135
01:30Socioemotional Experience and Gender Development
25
Social-emotional experiences and cultural influences play significant roles in shaping gender development. During middle childhood, from ages 6 to 11, peer groups become dominant in reinforcing gender norms. Children in this age group often align with same-gender peer groups, which actively encourage behaviors that conform to traditional gender roles. For instance, boys may be discouraged from engaging in activities perceived as feminine, reinforcing culturally dictated norms about masculinity...
25
01:30Classification of Signals
427
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
427
01:20Cognitive Theories: Schachter-Singer Theory of Emotion
347
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
347