自主监督学习从未修剪的视频通过等级一致性通过教学
IEEE transactions on pattern analysis and machine intelligence
|October 11, 2023
概括
本研究介绍了层次一致性 (HiCo++),这是一种自我监督学习的新框架,利用未经修剪的视频创建更好的时空表示,优于标准方法.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 对于时空表现的自主监督学习通常使用手动修剪的视频,限制视觉多样性和性能.
- 未修剪的视频提供了更丰富的内容,但对表示学习提出了挑战.
研究的目的:
- 通过使用自然,未经修剪的视频来改善视频表示.
- 开发一个框架,学习时间一致性的层次结构.
主要方法:
- 提出层次一致性 (HiCo++) 学习框架.
- 通过对比学习来学习视觉一致性 (短时间,视觉相似的剪辑).
- 通过主题分类器学习主题一致性 (长时间,与主题相关的剪辑).
- 采用逐步采样算法来进行层次一致性学习.
主要成果:
- HiCo++从未修剪的视频中生成更强大的表示.
- 该框架在应用到修剪的视频时可以提高表示质量.
- 在未经修剪的视频上表现出优于标准对比学习的优势.
结论:
- HiCo++有效地利用未经修剪的视频来增强自我监督的表示学习.
- 层次一致性方法比现有方法提供了显著的进步.
- 这一框架为从多样化,未经精准处理的视频数据中学习开辟了新的可能性.
相关概念视频
Survival Tree
89
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
89
Observational Learning
190
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
190
Trimmed Mean
2.9K
While measuring the mean of a data set, care needs to be taken when associating the mean to its central tendency. The same goes for the arithmetic mean, the geometric mean, or the harmonic mean. This is because the presence of a single outlier data value can significantly affect the mean. That is, the mean is sensitive to fluctuations in the data set.
Although certain measures of central tendency are not sensitive to outliers, there are alternative versions of the mean that get around the...
Although certain measures of central tendency are not sensitive to outliers, there are alternative versions of the mean that get around the...
2.9K
Residuals and Least-Squares Property
7.4K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.4K
Introduction to Learning
449
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
449
Hierarchy of Motor Control
2.8K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
2.8K


