在监督,半监督和自我监督的学习中调查对比的对学习的边界
Bihi Sabiri1, Amal Khtira2, Bouchra El Asri1
1IMS Team, ADMIR Laboratory, Rabat IT Center, ENSIAS, Mohammed V University in Rabat, Rabat 10000, Morocco.
Journal of imaging
|August 28, 2024
概括
对比式学习在深度图像模型的自我监督表示学习中表现出色. 这种方法结合了无监督的预训练和监督的微调,显著提高了分类准确性,即使有有限的标记数据.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 对比式学习是一种关键的自我监督表示学习技术.
- 它增强了对深度图像模型的无监督训练.
- 在未经监督的预训练后进行的监督微调有效地利用未标记的数据.
研究的目的:
- 将对比式学习与传统模型进行比较.
- 在分类任务中展示对比学习的优越性.
- 通过预训练,微调和超参数选择来优化性能.
- 在位置和照明等因素不变的情况下开发语义上有意义的表示.
主要方法:
- 使用对比学习技术进行无监督的预训练.
- 在标记数据的小子集上进行监督微调.
- 与传统的学习模式进行实验性比较.
- 系统的超参数选择和调整.
主要成果:
- 一个半监督模型实现了57.72%的准确性,5%的标记数据.
- 使用对比方法和调的监督学习达到85.43%的准确性.
- 进一步的超参数调整产生了88.70%的准确性.
结论:
- 对比式学习显著提高了深度图像模型的稳定性和准确性.
- 提出的无监督预训练和有监督的微调策略非常有效.
- 即使使用最小的标记数据,也可以通过对比学习来实现高精度.
相关概念视频
Associative Learning
317
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
317
Group Design
8.9K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
8.9K
Observational Learning
152
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
152
Cognitive Learning
233
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
233
Generalization, Discrimination, and Extinction
490
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
490
Self-Discrepancy Theory
18.3K
One influential perspective on what motivates people's behavior is detailed in Tory Higgin's self-discrepancy theory (Higgins, 1987). He proposed that people hold disagreeing internal representations of themselves that lead to different emotional states.
18.3K


