孟加拉语语音情感识别使用基于深度学习的集体学习和特征融合
Md Shahid Ahammed Shakil1, Fahmid Al Farid2, Nitun Kumar Podder1
1Department of Computer Science and Engineering, Pabna University of Science and Technology, Pabna 6600, Bangladesh.
Journal of imaging
|August 27, 2025
概括
这项研究为孟加拉语语音情感识别引入了一种新的深度学习方法, 这种方法增强了人机交互系统的情感识别能力.
科学领域:
- 语音处理
- 人工智能
- 人与计算机的交互
背景情况:
- 孟加拉语语音情感识别在准确性,语音依赖性和概括性方面面临挑战.
- 使用传统或基本深度学习模型的现有方法在各种条件下缺乏稳定性.
研究的目的:
- 为孟加拉语语音情感识别提出一种全新的多流深度学习特征融合方法.
- 通过提高准确性,稳定性和通用性来解决现有方法的局限性.
主要方法:
- 应用于训练数据集的数据增强技术.
- 手工制作的特征 (ZCR,MFCC等) 的提取 以及深度学习功能.
- 多流深度学习架构,包括1D CNN,CNN-LSTM和CNN-Bi-LSTM流.
- 通过软投票进行最终预测.
主要成果:
- 取得的高精度:SUBESCO的92.9%,孟加拉SER的85.20%,合并后的90.63%,RAVDESS的67.71%,EMODB的69.25%.
- 与现有方法相比,表现出更好的稳定性和通用性.
- 通过集体学习有效地结合手工制作和深度学习功能.
结论:
- 拟议的多流深度学习功能融合方法显著提高了孟加拉语语情感识别.
- 结合多种特征和集体学习,提供了更全面,更强大的解决方案.
- 这种方法为人与计算机交互系统的情感识别提供了有前途的进步.
相关概念视频
Labeling Emotion
237
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
237
Force Classification
1.6K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.6K
Classification of Signals
878
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
878
Physiology of Emotion
1.4K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
1.4K
Emotional Expression
367
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
367

