层次知识传播和蒸为少数人学习的学习
Chunpeng Zhou1, Haishuai Wang1, Sheng Zhou1
1Zhejiang Provincial Key Laboratory of Service Robot, College of Computer Science, Zhejiang University, Hangzhou, 310000, China.
概括
本研究介绍了层次知识传播和蒸 (HKPD),一种诱导性的短暂学习 (FSL) 框架. 通过探索样本和类关系,HKPD改进了表示学习,超越了当前最先进的方法.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 计算机视觉 计算机视觉
背景情况:
- 少数射击学习 (FSL) 研究已经取得了进展,但往往侧重于传导设置,受到小的未标记查询集的限制.
- 现有的感应FSL方法主要优化特征提取,可能忽视在低数据模式中的关键样本类关系动态.
研究的目的:
- 提出一种诱导性的Few-Shot学习 (FSL) 框架,分层知识传播和蒸 (HKPD),旨在增强表示学习.
- 通过明确模拟样本级和类级关系来解决现有的FSL方法的局限性.
主要方法:
- HKPD构建了一个样本级信息传播模块,以探索对对样本关系的歧视性表示.
- 一个类级信息传播模块旨在有效地获取和更新类级信息.
- 一个自蒸模块集成层次知识,在模块之间传播信息,以改进学习的表示.
主要成果:
- 拟议的HKPD方法在标准的几次射击基准数据集上表现出卓越的性能.
- 实验证实了分层知识传播和蒸方法在提高FSL性能方面的有效性.
- 在短时间的分类任务中,HKPD超越了当前最先进的方法.
结论:
- 通过有效地利用层次知识,HKPD提供了一种新的诱导方法来对Few-Shot学习.
- 该框架模拟样本间和样本类关系的能力是提高其在低数据场景中的表现的关键.
- 这项工作通过提供强大的方法来从有限的标记数据中学习,从而推进了感应式FSL.
相关概念视频
01:12Observational Learning
207
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
207
01:27Associative Learning
434
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
434
01:10Propagation of Uncertainty from Systematic Error
552
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
552
01:18Introduction to Learning
465
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
465
00:59Propagation of Uncertainty from Random Error
724
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
724
01:24Generalization, Discrimination, and Extinction
604
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
604