寒冷融合:校准和顺序潜分布融合,用于不确定性意识的多模式情感识别
IEEE transactions on pattern analysis and machine intelligence
|October 18, 2023
概括
这项研究引入了一种不确定性意识的方法,用于使用多式联络融合识别情绪. 该方法量化数据的不确定性,以提高模型的概括性和对噪声的稳定性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 情感计算是一种情感计算.
背景情况:
- 从多式联络数据 (面部,声音) 中识别情绪是具有挑战性的,因为输入数据和标签中存在固有的不确定性.
- 现有的机器学习框架往往难以有效量化和利用这些不确定性.
研究的目的:
- 开发一种不确定性意识的多式联络融合方法,以改善情绪预测.
- 为更好的情绪识别性能量化模式智能元器件不确定性.
- 增强情绪识别模型对抗新型噪音模式的稳定性.
主要方法:
- 通过限制差异,提出了一种新的融合框架,通过约束变异,在单模时间上下文中学习潜分布.
- 引入了差异约束 (校准和顺序排名) 来表示情感识别的模式信息性.
- 利用软max分布式匹配损失共同实施校准和顺序排名约束.
主要成果:
- 拟议的方法改善了AVEC 2019 CES,CMU-MOSEI和IEMOCAP数据集中的情感识别模型的概括性能.
- 增强预测不确定性估计,提供更好的模型信心洞察力.
- 模型在测试过程中遇到的新噪声模式的强度增加.
结论:
- 不确定性意识的多式联接融合方法有效地解决了情绪识别方面的挑战.
- 量化和利用模式智能的不确定性导致更准确和更强大的情绪预测模型.
- 该方法显示了对需要可靠的情感分析的现实世界应用的巨大潜力.
相关概念视频
Labeling Emotion
145
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
145
Uncertainty: Overview
570
In analytical chemistry, we often perform repetitive measurements to detect and minimize inaccuracies caused by both determinate and indeterminate errors. Despite the cares we take, the presence of random errors means that repeated measurements almost never have exactly the same magnitude. The collective difference between these measurements - observed values - and the estimated or expected value is called uncertainty. Uncertainty is conventionally written after the estimated or expected value.
570
Uncertainty: Confidence Intervals
4.1K
The confidence interval is the range of values around the mean that contains the true mean. It is expressed as a probability percentage. The interpretation of a 95% confidence interval, for instance, is that the statistician is 95% confident that the true mean falls within the interval. The upper and lower limits of this range are known as confidence limits. The confidence limits for the true mean are estimated from the sample's mean, the standard deviation, and the statistical factor...
4.1K
Calibration Curves: Linear Least Squares
1.3K
A calibration curve is a plot of the instrument's response against a series of known concentrations of a substance. This curve is used to set the instrument response levels, using the substance and its concentrations as standards. Alternatively, or additionally, an equation is fitted to the calibration curve plot and subsequently used to calculate the unknown concentrations of other samples reliably.
For data that follow a straight line, the standard method for fitting is the linear...
For data that follow a straight line, the standard method for fitting is the linear...
1.3K
Multi-input and Multi-variable systems
110
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
110
Calibration Curves: Correlation Coefficient
1.6K
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the...
1.6K


