重温现实的测试时间训练:通过定集群的顺序推理和适应,规范化的自我训练
IEEE transactions on pattern analysis and machine intelligence
|February 28, 2024
概括
这项研究澄清了测试时间培训 (TTT) 协议,并介绍了TTAC++,这是一种用于模型适应的新方法. 在各种具有挑战性的数据集中,TTAC++ 改进了功能学习,并超越了现有的方法.
科学领域:
- 机器学习 机器学习
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 模型部署经常面临分布转移,需要适应.
- 测试时间培训 (TTT) 解决了当源数据不可用并且快速推断至关重要时的适应问题.
- 现有的TTT研究缺乏标准化的实验设置,阻碍了公平的比较.
研究的目的:
- 建立明确的TTT协议和假设.
- 开发一个强大的TTT方法,以改善特征学习和适应.
- 为TTT方法提供一个公平的比较框架.
主要方法:
- 基于数据流和源模型重新训练的TTT协议的分类.
- 开发测试时间定集群 (TTAC) 用于特征学习和域调整.
- 引入TTAC++,一种规范自我训练的方法,用于增强TTT.
主要成果:
- 在五个不同的TTT数据集中,TTAC++展示了卓越的性能.
- 提议的TTAC方法有效地学习特征并改善适应性,即使在无源场景中也是如此.
- 在各种TTT协议下,TTAC++的持续优于最先进的方法.
结论:
- 标准化的TTT协议对于可靠的研究和开发至关重要.
- 在测试时间适应方面,TTAC++提供了显著的进步,解决了先前方法的局限性.
- 这项工作为公平的基准测试和TTT的未来进步提供了基础.
更多相关视频
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
7.5K
06:37Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
Published on: December 15, 2023
3.8K
相关概念视频
Survival Tree
85
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
85
The Anchoring-and-Adjustment Heuristic
7.2K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.2K
Associative Learning
358
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
358
Generalization, Discrimination, and Extinction
552
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
552
Prediction Intervals
2.3K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
2.3K
Improving Translational Accuracy
10.4K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
10.4K
