关于注意力和增强对于域调整和泛化中的假设转移的重要性
Rajat Sahay1, Georgi Thomas1, Chowdhury Sadman Jahan1
1Rochester Institute of Technology, Rochester, NY 14623, USA.
Sensors (Basel, Switzerland)
|October 28, 2023
概括
计算机视觉中的注意力机制,特别是ConvNeXt和SWIN变压器,显著改善了无监督域适应 (UDA). 在源假设转移 (SHOT) 框架内的现代化培训进一步提高了性能,特别是对于空中数据集.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 无监督域调整 (UDA) 解决了数据分布转移造成的性能下降问题.
- 卷积神经网络 (CNN) 已经成为UDA中特征提取的标准.
- 基于注意力的变压器模型为计算机视觉任务提供了有希望的替代方案.
研究的目的:
- 基于注意力的变压器架构 (ViT,SWIN,DAVIT) 与UDA的CNN (ResNet,HRNet) 和ConvNeXt进行比较.
- 通过使用源假设转移 (SHOT) 框架评估域泛化和适应的骨干性能.
- 评估现代化的培训程序,包括图像增强,对UDA绩效的影响.
主要方法:
- 作为SHOT框架内的特征提取器,内置视觉变压器 (ViT),移动窗口变压器 (SWIN) 和双注意力视觉变压器 (DAViT).
- 员工自我监督的深度功能聚类和自我培训,用于对准未标记的目标域数据.
- 在培训过程中应用了现代图像增强技术.
主要成果:
- ConvNeXt和SWIN架构在域泛化和适应方面表现出卓越的性能.
- 注意力机制在变压器和卷积架构中被证明是非常有益的.
- 现代化的培训配方显著提高了空中UDA数据集的性能.
结论:
- 注意力机制对于有效的无监督领域适应至关重要.
- 对于UDA任务,ConvNeXt和SWIN是推的支持架构.
- 增强的训练策略,特别是用于空中成像,可以显著提高性能.
相关概念视频
Generalization, Discrimination, and Extinction
578
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
578
What is a Hypothesis?
11.0K
A hypothesis can be a simple sentence or statement about a property or any phenomenon observed or predicted for a population. It is usually a claim about a property of the population. It can be stated for any field observations or experiments. A hypothesis statement cannot be said to be right or wrong as it is merely a statement. It needs to be tested through an elaborate data collection process and an appropriate statistical test. A hypothesis should be a general but not a vague...
11.0K
Hypothesis: Accept or Fail to Reject?
27.9K
The outcome of any hypothesis testing leads to rejecting or not rejecting the null hypothesis. This decision is taken based on the analysis of the data, an appropriate test statistic, an appropriate confidence level, the critical values, and P-values. However, when the evidence suggests that the null hypothesis cannot be rejected, is it right to say, 'Accept' the null hypothesis?
There are two ways to indicate that the null hypothesis is not rejected. 'Accept' the null...
There are two ways to indicate that the null hypothesis is not rejected. 'Accept' the null...
27.9K
Accuracy and Errors in Hypothesis Testing
203
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
203
Statistical Hypothesis Testing
1.9K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
1.9K
Attribution Theory
13.0K
Behavior is a product of both the situation (e.g., cultural influences, social roles, and the presence of bystanders) and of the person (e.g., personality characteristics). Subfields of psychology tend to focus on one influence or behavior over others. Situationism is the view that our behavior and actions are determined by our immediate environment and surroundings. In contrast, dispositionism holds that our behavior is determined by internal factors (Heider, 1958).
13.0K


