对比式学习解锁了用于数据集修剪的几何洞察力
Hongjia Xu1, Sheng Zhou2, Zhuonan Zheng1
1Zhejiang Key Laboratory of Accessible Perception and Intelligent Systems, Zhejiang University, Hangzhou, 310027, China; College of Computer Science and Technology, Zhejiang University, Hangzhou, 310027, China.
概括
本研究介绍了KITTY采样,这是一种使用对比学习和多重曲率的无监督数据集修剪方法. 它通过降低高密度区域的样本,高效地选择数据子集,提高模型性能,而无需昂贵的标签.
科学领域:
- 计算机科学 计算机科学
- 机器学习 机器学习
- 数据科学数据科学数据科学
背景情况:
- 数据集修剪对于管理大数据至关重要,特别是在不受监督的环境中,以避免昂贵的标签.
- 现有的无监督方法通常将表示学习视为黑子,对嵌入属性的有限探索进行修剪.
研究的目的:
- 通过分析已学习的嵌入式多元体的几何性质,开发出有效的无监督数据集修剪策略.
- 为了利用对比学习的嵌入空间来有效地选择数据.
主要方法:
- 通过观察已学习的嵌入式多元体,重新审视自我监督的对比学习.
- 介绍曲率估计来描述多元体几何学.
- 建议KITTY采样:一种无监督的策略,涉及在高实例密度地区进行低采样.
主要成果:
- 统计分析显示了嵌入式多元面上的非均实例分布.
- 与基线方法相比,KITTY采样在计算机视觉数据集修剪任务中显示出领先的性能.
- 拟议的方法有效地修剪数据集,而不会影响模型性能.
结论:
- 无监督的数据集修剪可以通过了解嵌入式的几何结构来显著增强.
- 在大数据时代,KITTY采样提供了一种高效有效的数据集修剪方法.
- 该研究强调了几何分析在数据管理任务的表示学习中的潜力.
相关概念视频
Survival Tree
388
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
388
Cognitive Learning
1.0K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.0K
Causes of Similarity-Dissimilarity Effect
254
The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
254
Observational Learning
838
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
838
Graphical Representation of Inequalities
174
The graph of the equation where y equals x squared forms a curve known as a parabola. This curve acts as a boundary in the coordinate plane, dividing it into distinct regions based on the relative position of points.When the equality sign in the equation is replaced with an inequality—such as greater than, less than, greater than or equal to, or less than or equal to—the graphical representation changes from a single curve into a broader shaded area that signifies the set of all...
174
Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K


