通过隐性关系循环的自动配对正向对歧视性自我学习的循环
概括
隐式关系循环 (IRC) 通过使用随机步行和循环一致性,使得没有明确的正对的对比学习成为可能. 这种自动配对机制扩展了对比式学习应用在密集,多模式和视觉语言任务中.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 代表性学习学习学习
背景情况:
- 对比式学习是一种流行的自我监督学习框架,用于表示学习.
- 传统的对比方法需要精心设计的正对,限制它们在复杂场景中的应用.
- 像密集预测,多模式数据和视觉语言任务这样的场景往往缺乏容易获得的正对.
研究的目的:
- 引入一种自动配对机制,即隐性关系循环 (IRC),用于歧视性的自我学习框架.
- 克服对比学习中明确正对要求的局限性.
- 为了在积极对很难获得的场景中实现对比学习.
主要方法:
- 对于一个复杂的任务 (任务C),IRC采用了跨特征组的随机步行,没有明确的配对.
- 一个简单的任务 (Task S) 使用易于获得的对来连接随机步行的开始和结束,形成一个循环.
- 循环一致性被用作监督信号,在随机步行中自动学习正对.
主要成果:
- 在学习密集图像像素关系,3D点云关系和图像表示语言方面,IRC表现出有效性.
- 在各种任务中观察到显著的性能改进,包括语义细分 (3.0 mIoU),3D细分 (1.5 mIoU),3D检测 (1.3 mAP) 和图像分类 (1.2 top1精度).
- 这些收益是以最小的参数和计算开销实现的,展示了IRC的效率.
结论:
- 隐性关系循环 (IRC) 是一种多功能,插即用机制,增强了歧视性自我学习.
- 在对比式学习中,IRC成功地解决了正对获得的挑战.
- 拟议的方法为表示学习提供了一种新的方法,扩大其适用于多样化和具有挑战性的领域.
相关概念视频
01:27Associative Learning
276
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
276
01:24Implicit Memories
81
Implicit memories, also known as non-declarative memories, are long-term memories that function outside of conscious awareness. These memories influence behavior and skills without explicit knowledge. This type of memory is evident in tasks like playing tennis, snowboarding, and texting. Implicit memory has three subsystems: procedural memory, conditioning, and priming. This type of memory is essential in various activities, from everyday tasks to specialized skills.
One key aspect of implicit...
One key aspect of implicit...
81
01:13Nonconscious Mimicry
4.5K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.5K
01:22Purposive Learning
96
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
96
02:55Stereotypes, Prejudice, and Discrimination
89.8K
Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who...
89.8K
02:12Relationship Formation
39.6K
What do you think is the single most influential factor in determining with whom you become friends and whom you form romantic relationships? You might be surprised to learn that the answer is simple: the people with whom you have the most contact. This most important factor is proximity. You are more likely to be friends with people you have regular contact with. For example, there are decades of research that shows that you are more likely to become friends with people who live in your dorm,...
39.6K