基于相对正规化和测量传播的无监督域适应方法
Lianghao Tan1, Zhuo Peng1, Yongjia Song2
1Department of Computer Science, Arizona State University, Tempe, AZ 85281, USA.
Entropy (Basel, Switzerland)
|April 26, 2025
概括
本研究引入了一个新的无监督域适应框架,使用信息理论来减少域差异. 该方法改善了特征对齐和语义一致性,优于对基准数据集的现有方法.
科学领域:
- 计算机科学 计算机科学
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 无监督域调整 (UDA) 对于将模型应用于新数据分布至关重要.
- 源域和目标域之间的分布差异阻碍了模型的泛化.
- 现有的UDA方法往往会在显著的域名转移中扎.
研究的目的:
- 提出一个新的UDA框架,整合信息理论原则.
- 有效地减轻源域和目标域之间的分布差异.
- 为了提高全球特征对齐和语义一致性.
主要方法:
- 使用Kullback-Leibler (KL) 分歧来调整标签分布的相对调整.
- 测量传播以转移概率质量并为目标域创建伪测量.
- 一个双重机制,将这些组成部分结合起来,以实现强大的适应.
主要成果:
- 拟议的框架在OfficeHome和DomainNet数据集上始终优于最先进的方法.
- 观察到优异的性能,特别是在具有显著域位移的场景中.
- 证明了UDA框架的稳定性,可扩展性和理论依据.
结论:
- 新的UDA框架有效地减少了域名分布上的差异.
- 信息理论原则的整合为领域适应提供了新的视角.
- 该方法显示了跨域概括能力的显著改进.
相关概念视频
Propagation of Uncertainty from Random Error
533
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
533
Propagation of Uncertainty from Systematic Error
373
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
373
Variation
6.7K
An important characteristic of any set of data is the variation in the data. In some data sets, the data values are concentrated closely near the mean; in other data sets, the data values are more widely spread out from the mean. The most common measure of variation, or spread, is the standard deviation, which is the square root of variance.
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
6.7K
Mean Absolute Deviation
2.5K
The mean absolute deviation is also a measure of the variability of data in a sample. It is the absolute value of the average difference between the data values and the mean.
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
2.5K
Residuals and Least-Squares Property
7.2K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.2K
Relative Frequency Distribution
10.4K
A relative frequency distribution is the proportion or fraction of times a value occurs in a data set. To find the relative frequencies, one can divide each frequency by the total number of data points in the sample. It is very similar to a regular frequency distribution, except that instead of reporting how many data values fall in a class, a relative frequency distribution reports the fraction of data values that fall in a class. These fractions or proportions are called relative frequencies...
10.4K


