无监督域名适应与不对称的边际差异损失和异常值样本提取
Chunmei He1, Xianjun Fan1, Kang Zhou1
1School of Computer Science, School of Cyberspace Science, Xiangtan University, Xiangtan, Hunan 411105, China.
概括
本研究介绍了AMD-Net与OSE,这是一种新的无监督域调整方法. 它通过解决令人困惑的目标样本和源域异常值来改善特征提取,实现最先进的性能.
科学领域:
- 计算机科学 计算机科学
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 无监督域调整 (UDA) 将知识从标记的源域转移到没有标记的目标域.
- 现有的UDA方法在分类相似的目标样本和减轻源域异常值的负转移方面存在困难.
- 需要UDA技术来增强特征区分,并有效地处理域差异.
研究的目的:
- 提出一种新的UDA方法,AMD-Net与OSE,以解决当前方法的局限性.
- 改进特征提取能力,防止模型趋同到局部最佳.
- 为了有效地处理目标域中的令人困惑的样本,并减轻源域异常值的负面转移.
主要方法:
- 开发了一种不对称的边际差异差异 (AMD) 方法,利用多标签度量来混目标样本.
- 实施了一种带有样本选择机制的渐进式学习方案,根据样本确定性应用不同的损失函数.
- 引入了一个异常值样本提取 (OSE) 算法,使用加权的等号相似性来减少源域异常值的负转移.
主要成果:
- 与OSE一起的AMD-Net在四个基准数据集中表现出卓越的性能:Office-31,Office-Home,VisDA-2017和DomainNet.
- 该方法有效地改善了特征提取,并成功处理了令人困惑的样本和源域异常值.
- 在各种无监督域调整场景中取得了最先进的结果.
结论:
- 与OSE一起的AMD-Net为无监督域调整挑战提供了强大的解决方案.
- 拟议的AMD和OSE组件显著提高了模型性能和通用性.
- 这项工作通过为域名转移提供更有效的方法,推动了UDA领域的发展.
相关概念视频
What Are Outliers?
3.9K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.9K
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Outliers and Influential Points
4.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.1K
Margin of Error
4.2K
The margin of error is also called the maximum error of an estimate. The margin of error is the maximum possible or expected difference between the observed sample parameter value and the actual population parameter value. For proportion, it is the maximum difference between the value of sample proportion obtained from the data and the true value of population proportion. As the true value of the population parameter is not known, the margin of error is calculated using the sample statistic.
4.2K
Detection of Gross Error: The Q Test
6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Cluster Sampling Method
12.0K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
12.0K


