通过采样多阶段任务进行少量拍摄的课堂增量学习
IEEE transactions on pattern analysis and machine intelligence
|October 11, 2023
概括
极限,一种新的元学习方法,有效地识别了一些新类的新类,同时保留了旧类的知识. 这种方法将任务综合起来,构建一个可概括的特征空间,在增量学习中抵抗灾难性遗忘.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 现实世界的动态性需要人工智能模型,这些模型可以适应新的信息,而不会失去以前获得的知识.
- 简单的班级增量学习 (FSCIL) 解决了识别具有有限数据的新课程的挑战,同时保持现有课程的性能.
- 现有的方法在增量学习场景中扎着灾难性的遗忘和有限的数据可用性.
研究的目的:
- 引入一个新的元学习范式,Limit (学习多阶段的增量任务),用于短暂的课堂增量学习.
- 开发一种有效地适应新类的方法,并减轻旧类的遗忘.
- 建立一个强大的框架来识别使用最小数据的新类,同时保持已建立类的性能.
主要方法:
- 限制从基础数据集中合成假的FSCIL任务,以创建一个元学习环境.
- 一个基于变压器的校准模块对齐了旧的和新的类表示,弥合了语义差距.
- 特定实例的嵌入被通过校准模块中的设置到设置函数进行自适应式上下文化.
主要成果:
- 极限证明了基准数据集的最新性能,包括CIFAR100,miniImageNet和CUB200.
- 该方法在适应新课程和抵抗灾难性遗忘方面取得了显著的改进.
- 在大规模的ImageNet ILSVRC2012数据集上的实验验证实了Limit范式的有效性.
结论:
- 极限提供了一种有效的解决方案,通过利用元学习和一个新的校准模块,为少数人群的阶级增量学习提供了有效的解决方案.
- 提出的方法成功地平衡了新类的认可与保留旧类知识.
- 极限提供了一个可扩展和高性能框架,用于现实世界的应用程序,需要从有限的数据不断学习.
更多相关视频
相关概念视频
Sampling Plans
192
Sampling is a crucial step in analytical chemistry, allowing researchers to collect representative data from a large population. Common sampling methods include random, judgmental, systematic, stratified, and cluster sampling.
Random sampling is a method where each member of the population has an equal chance of being selected for the sample. It involves selecting individuals randomly, often using random number generators or lottery-type methods. For example, when analyzing the properties of a...
Random sampling is a method where each member of the population has an equal chance of being selected for the sample. It involves selecting individuals randomly, often using random number generators or lottery-type methods. For example, when analyzing the properties of a...
192
Sampling Methods: Overview
357
A sample refers to a smaller subset representative of a larger population. In analytical chemistry, studying or analyzing an entire population is often impractical or impossible. Therefore, samples are used to draw inferences and generalize the whole population. The sampling method selects individuals or items from a population to create a sample. Standard sampling methods include random, judgemental, systematic, stratified, and cluster sampling.
In analytical chemistry, the choice of...
In analytical chemistry, the choice of...
357
Sampling Methods: Sample Types
248
Sampling materials are classified into three main types: solid, liquid, and gas.
Solid samples include a variety of substances, such as sediments from water bodies, soil, metals, and biological tissues. Two standard methods for extracting sediments from water bodies are grab sampling and piston coring. Grab sampling involves using a device to collect a discrete sediment sample from the bottom of a water body with minimal disturbance. Grab samples do not always represent the entire area due to...
Solid samples include a variety of substances, such as sediments from water bodies, soil, metals, and biological tissues. Two standard methods for extracting sediments from water bodies are grab sampling and piston coring. Grab sampling involves using a device to collect a discrete sediment sample from the bottom of a water body with minimal disturbance. Grab samples do not always represent the entire area due to...
248
Random Sampling Method
11.2K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...
11.2K
Observational Learning
190
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
190
Sampling Continuous Time Signal
269
In signal processing, a continuous-time signal can be sampled using an impulse-train sampling technique, followed by the zero-order hold method. Impulse-train sampling involves the use of a periodic impulse train, which consists of a series of delta functions spaced at regular intervals determined by the sampling period. When a continuous-time signal is multiplied by this impulse train, it generates impulses with amplitudes corresponding to the signal's values at the sampling points.
In the...
In the...
269


