相关实验视频
Updated: Sep 17, 2025

08:35
An Operant Intra-/Extra-dimensional Set-shift Task for Mice
Published on: January 22, 2016
12.4K
概括
非对比的自我监督学习需要很大的表示维度,导致效率低下. 本研究从理论上分析了这种维度需求,证明性能取决于输出维度与潜在类.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 计算机视觉 计算机视觉
背景情况:
- 非对比的自我监督学习避免了负样本,但往往需要很大的表示维度,导致维度低效.
- 相反的学习方法,虽然避免了大尺寸,但需要大批次大小,导致样本效率低下.
研究的目的:
- 提供非对比式学习中维度要求的理论分析.
- 调查表示学习和下游任务执行之间的关系.
- 了解非对比方法如何隐含地增加类间距离,以及它们对模型性能的影响.
主要方法:
- 在非对比学习中对维度需求的理论分析.
- 调查从上游代表性学习到下游任务的转移学习绩效.
- 在图像分类,音频,图形和文本模式的实证验证,包括检测和细分任务.
主要成果:
- 非对比的学习表现受到输出维度相对于潜在类数量的显著影响.
- 当输出维度大大小于潜在类数时,性能会降低.
- 通过非对比方法暗示增加类间距离,并与表现相关.
结论:
- 在理论上解释了非对比学习的维度低效率.
- 在输出维度,隐性类和模型性能之间建立了明确的关系.
- 结果在各种数据模式和下游任务中得到验证,证实了理论预测.
更多相关视频
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
7.7K
06:33Decomposing the Variance in Reading Comprehension to Reveal the Unique and Common Effects of Language and Decoding
Published on: October 11, 2018
6.9K
相关概念视频
Dimensional Analysis
17.0K
The concept of dimension is important because every mathematical equation linking physical quantities must be dimensionally consistent, implying that mathematical equations must meet the following two rules. The first rule is that, in an equation, the expressions on each side of the equal sign must have the same dimensions. This is fairly intuitive since we can only add or subtract quantities of the same type (dimension). The second rule states that, in an equation, the arguments of any of the...
17.0K
Problem Solving: Dimensional Analysis
4.6K
Every mathematical equation that connects separate distinct physical quantities must be dimensionally consistent, which implies it must abide by two rules. For this reason, the concept of dimension is crucial. The first rule is that an equation's expressions on either side of an equality must have the exact same dimension, i.e., quantities of the same dimension can be added or removed. The second rule stipulates that all popular mathematical functions, such as exponential, logarithmic, and...
4.6K
Purposive Learning
208
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
208
Cognitive Learning
551
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
551
Real-World Application of Classical Conditioning
745
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
745
Associative Learning
596
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
596