SMURF:统计方式 独特性和冗余性 分数分解
Torsten Wörtwein1, Nicholas B Allen2, Jeffrey F Cohn3
1Educational Testing Service, Pittsburgh, PA, USA.
Proceedings of the ... ACM International Conference on Multimodal Interaction. ICMI (Conference)
|December 13, 2024
概括
我们开发了统计模式独特性和冗余因子 (SMURF) 以使多式联体晚期聚变模型更易于解释和更强大. SMURF将唯一和共享模式贡献分开,改善对缺失数据的理解和处理.
科学领域:
- 多模式机器学习是多模式机器学习.
- 情感计算是一种情感计算.
- 人工智能的人工智能是人工智能.
背景情况:
- 多模式晚期聚变模型将来自不同来源 (例如视觉,音频,文本) 的信息结合起来,以改善预测.
- 目前的晚期聚变方法在单个模式贡献方面缺乏可解释性.
- 需要提高这些模型的稳定性,以弥补缺失的数据模式.
研究的目的:
- 通过因子化模式贡献来提高晚期核聚变模型的解释性.
- 为了提高晚期核聚变模型的稳定性,以缺失的模式.
- 引入一种新的晚期融合方法,统计方式独特性和冗余因子化 (SMURF).
主要方法:
- 提出SMURF,这是一种晚期聚变方法,将贡献分成单独的和双重冗余的组件.
- 独一无二的贡献与其他模式无关.
- 双重冗余贡献在两个模式之间最大限度地相关.
主要成果:
- 在合成数据上验证了SMURF的因数分解,并且在八个情感数据集中没有显示出预测性能的退化.
- 通过SMURF学习的因数分解与人类对三组数据集的判断有显著的相关性.
- 与基线方法相比,SMURF表现出了对缺失的模式的更好的稳定性.
结论:
- SMURF成功地对模式贡献进行了因子化,提高了晚期融合中的解释性.
- 拟议的方法提高了模型稳定性,当缺少模式时.
- SMURF为开发更加透明和弹性的多式联运人工智能系统提供了一个有前途的方法.
相关概念视频
01:07What is a Mode?
18.1K
The mode is one of the commonly used measures of a central tendency. It is defined as the most frequent value in a data set.
There can be more than one mode in a data set if multiple values have the same highest frequency. For instance, suppose that the Statistics exam scores of 20 students are: 50; 53; 59; 59; 63; 63; 72; 72; 72; 72; 72; 76; 78; 81; 83; 84; 84; 84; 90; 93. Here, the mode is 72, as it occurs most frequently, five times.
A data set with two modes is called bimodal. For example,...
There can be more than one mode in a data set if multiple values have the same highest frequency. For instance, suppose that the Statistics exam scores of 20 students are: 50; 53; 59; 59; 63; 63; 72; 72; 72; 72; 72; 76; 78; 81; 83; 84; 84; 84; 90; 93. Here, the mode is 72, as it occurs most frequently, five times.
A data set with two modes is called bimodal. For example,...
18.1K
01:11Variability: Analysis
126
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
The range is a simple measure of variability, indicating the difference between the highest and...
126
01:16Second Uniqueness Theorem
975
Consider a region consisting of several individual conductors with a definite charge density in the region between these conductors. The second uniqueness theorem states that if the total charge on each conductor and the charge density in the in-between region are known, then the electric field can be uniquely determined.
In contrast, consider that the electric field is non-unique and apply Gauss's law in divergence form in the region between the conductors and the integral form to the...
In contrast, consider that the electric field is non-unique and apply Gauss's law in divergence form in the region between the conductors and the integral form to the...
975
01:19Expected Frequencies in Goodness-of-Fit Tests
2.5K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.5K
01:16Unusual Results
3.1K
Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
3.1K
01:11Statistical Analysis: Overview
6.1K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.1K