从非IID数据与分布外样本的灰色学习
IEEE transactions on neural networks and learning systems
|November 14, 2023
概括
本研究介绍了灰色学习 (GL),这是一种用于训练具有不可靠数据的强大神经网络的新方法. GL有效地使用互补标签来改善非独立和相同分布 (非IID) 数据集的模型性能.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 计算机科学 计算机科学
背景情况:
- 训练数据的完整性至关重要,但往往会受到损害,特别是在非独立和相同分布的 (非IID) 数据集中.
- 专家的注释可能是不可靠的,分布之外的样本被错误地归类为分布中的样本,这导致了强大的神经网络培训的挑战.
研究的目的:
- 解决从数据集中学习强大的神经网络的挑战,这些数据集具有不可靠的标签和混合的数据分布.
- 利用补充标签,表示样本不属于的类别,以改善模型概括性.
主要方法:
- 引入了灰色学习 (GL),一种新的方法,利用基本真理和补充标签.
- 根据预测可靠性,GL可根据不同的标签类型适应性地调整损失重量.
- 基于统计学学习理论的衍生泛化误差界限,以证明GL在非IID设置中的有效性.
主要成果:
- 灰色学习 (GL) 即使在非IID设置中也实现了严格的概括错误约束.
- 实验性评估表明,GL显著优于其他基于统计数据的可靠方法.
- 该方法有效地处理数据集,其中混合了分布式和非分布式样本以及不可靠的标签.
结论:
- 灰色学习 (GL) 提供了一个强大的解决方案,用于训练具有数据完整性的神经网络.
- 基准真相和补充标签的适应权重在具有挑战性的非IID场景中增强了模型概括性.
- 与现有方法相比,GL表现出卓越的性能,为更可靠的AI系统铺平了道路.
相关概念视频
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Detection of Gross Error: The Q Test
6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Outliers and Influential Points
4.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.1K
Sampling Distribution
12.8K
Given simple random samples of size n from a given population with a measured characteristic such as mean, proportion, or standard deviation for each sample, the probability distribution of all the measured characteristics is called a sampling distribution. How much the statistic varies from one sample to another is known as the sampling variability of a statistic. You typically measure the sampling variability of a statistic by its standard error. The standard error of the mean is an example...
12.8K
Generalization, Discrimination, and Extinction
575
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
575
Difference from Background: Limit of Detection
6.4K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.4K


