相关实验视频
多样化和征服:为具有异常值的强大半监督学习提供开放式不同意见
IEEE transactions on neural networks and learning systems
|March 28, 2025
概括
本研究介绍了多元化和征服 (DAC) 框架,以提高半监督学习 (SSL) 对未标记数据中异常值的稳定性. 通过利用多个模型之间的分歧,DAC有效地识别未知类,优于现有方法.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 半监督学习 (SSL) 假设标记和未标记数据中的类分布相同,在现实世界的场景中,异常值往往会违反异常值.
- 在未标记数据中的异常值通常被视为噪声,显著降低SSL模型性能.
- 现有的开放式SSL (OSSL) 方法在没有足够的标记数据的情况下扎,导致性能下降.
研究的目的:
- 提出一个新的框架,多元化和征服 (DAC),以提高SSL在开放场景中的稳定性.
- 开发一种强大的异常值检测方法,即使使用低规格的标记数据,也有效.
- 通过利用多个模型之间的预测差异来识别未知的概念.
主要方法:
- 在一个单一的培训过程中,DAC框架构建了多个不同偏见的模型.
- 它鼓励不同的模型头向异常值表现出不同的偏差,同时保持对内向值的一致预测.
- 这些不同偏见的模型之间的预测分歧被利用来检测未知的概念.
主要成果:
- 拟议的DAC方法证明了强大的异常值检测能力,即使有有限的标记数据.
- 在各种实验性协议中,DAC显著优于现有的最先进的OSSL方法.
- 该框架有效地减轻了半监督学习中的异常值引起的绩效下降.
结论:
- 通过有效处理异常值,DAC框架为开放式半监督学习提供了一个强大的解决方案.
- 利用各种模型之间的预测分歧是发现异常值和识别未知概念的有希望的策略.
- DAC增强了SSL在包含未知类的现实数据集中的实际应用性.
相关概念视频
What Are Outliers?
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
Outliers and Influential Points
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the vertical...
Detection of Gross Error: The Q Test
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
Quantifying and Rejecting Outliers: The Grubbs Test
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...
Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Survival Tree
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a survival tree begins...
Building a Survival Tree
Constructing a survival tree begins...