在不平衡的子群体上使用噪音标签学习
概括
这项研究引入了一种新的学习方法,使用噪音标签 (LNL) 来解决不平衡的子群体. 它通过纠正噪音标签和使用分布性强优化 (DRO) 来提高模型的稳定性.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 计算机视觉 计算机视觉
背景情况:
- 使用噪音标签学习 (LNL) 是一个重要的研究领域.
- 当前的LNL方法在不平衡的子群体中经常失败,原因是"小损失"假设.
- 这导致了信息样本的错误分类和糟糕的概括.
研究的目的:
- 为处理杂标签和不平衡子群提出一种新的LNL方法.
- 为了提高模型在现实世界中与数据不平衡的场景中的概括性能.
主要方法:
- 利用样本相关性来估计清洁标签的概率.
- 引入基于特征的指标,考虑样本相关性,用于概率估计.
- 使用估计的概率和伪标签进行噪音标签的翻新.
- 采用分布性稳健优化 (DRO) 与经过翻新的标签,以应对亚群不平衡的稳健性.
主要成果:
- 提出的方法有效地同时处理杂的标签和不平衡的子群.
- 它不断改进最先进的 (SOTA) LNL 方法,特别是在不平衡的场景中.
- 跨各种基准的实验结果验证了该技术的有效性.
结论:
- 新的LNL方法为带有噪音标签和不平衡子群的数据集提供了强大的解决方案.
- 这种方法通过解决以前的LNL技术的局限性来增强模型的概括性.
- 提供的代码有助于进一步研究和应用该技术.
更多相关视频
07:31Defining the Role Of Language in Infants' Object Categorization with Eye-tracking Paradigms
Published on: February 8, 2019
6.6K
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
7.5K
相关概念视频
Distributions to Estimate Population Parameter
4.1K
The accurate values of population parameters such as population proportion, population mean, and population standard deviation (or variance) are usually unknown. These are fixed values that can only be estimated from the data collected from the samples. The estimates of each of these parameters are sample proportion, the sample mean, and sample standard deviation (or variance). To obtain the values of these sample statistics, data are required that have particular distribution and central...
4.1K
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Estimating Population Mean with Unknown Standard Deviation
7.7K
In practice, we rarely know the population standard deviation. In the past, when the sample size was large, this did not present a problem to statisticians. They used the sample standard deviation s as an estimate for σ and proceeded as before to calculate a confidence interval with close enough results. However, statisticians ran into problems when the sample size was small. A small sample size caused inaccuracies in the confidence interval.
William S. Gosset (1876–1937) of the...
William S. Gosset (1876–1937) of the...
7.7K
Testing a Claim about Population Proportion
3.3K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
3.3K
Estimating Population Standard Deviation
3.0K
When the population standard deviation is unknown and the sample size is large, the sample standard deviation s is commonly used as a point estimate of σ. However, it can sometimes under or overestimate the population standard deviation. To overcome this drawback, confidence intervals are determined to estimate population parameters and eliminate any calculation bias accurately. However, this only applies to random samples from normally distributed populations. Knowing the sample mean and...
3.0K
Testing a Claim about Mean: Known Population SD
2.7K
A complete procedure of testing the hypothesis about a population mean is explained here.
Estimating a population mean requires the samples to be distributed normally. The data should be collected from the randomly selected samples having no sampling bias. The sample size needed to be higher than 30, and most importantly, the population standard deviation should be already known.
In most realistic situations, the population standard deviation is often unknown, but in rare circumstances, when it...
Estimating a population mean requires the samples to be distributed normally. The data should be collected from the randomly selected samples having no sampling bias. The sample size needed to be higher than 30, and most importantly, the population standard deviation should be already known.
In most realistic situations, the population standard deviation is often unknown, but in rare circumstances, when it...
2.7K
