通过增加代表性等级和功能丰富性来提高课堂增量学习中的前兼容性.
Jaeill Kim1, Wonseok Lee2, Moonjung Eo3
1LINE Investment Technologies, 117 Bundangnaegok-ro, Bundang-gu, Seongnam-si, 13529, South Korea.
概括
我们引入了功能丰富度增强 (RFR) 方法,以提高类增量学习 (CIL) 的前向兼容性. 通过增加功能丰富度,RFR提高了新任务性能,并减轻了灾难性遗忘.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 班级增量学习 (CIL) 使模型能够在不忘记过去的知识的情况下顺序学习.
- 现有的CIL方法主要侧重于向后兼容性,冒着对新任务的性能风险.
- 未来兼容性方法正在出现,以提高未见任务的性能.
研究的目的:
- 引入一个有效的方法,功能丰富度增强 (RFR),以改善CIL的前兼容性.
- 提高模型学习新任务的能力,而不会损害先前获得的知识.
- 在持续学习中实现向后和向前兼容的双重目标.
主要方法:
- 拟议的RFR方法在基础学习时增加了表示的有效排名.
- 建立了有效等级和表示的香农的理论联系.
- RFR与11种已建立的CIL方法进行了整合和测试.
主要成果:
- RFR有效地提高了新任务的性能.
- 该方法显示了灾难性遗忘的显著缓解.
- 在所有11种经过测试的CIL方法中,平均增量精度有所改善.
结论:
- RFR方法提供了一个强大的方法来提高CIL的前兼容性.
- RFR成功地平衡了学习新信息与保留旧知识.
- 这种增强导致在持续学习场景中整体表现优越.
相关概念视频
Improving Translational Accuracy
9.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
9.0K
Associative Learning
289
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
289
Long-term Potentiation
2.7K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
2.7K
Survival Tree
60
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
60
Generalization, Discrimination, and Extinction
440
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
440
Aggregates Classification
303
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
303


