作为的原型:解决在线持续学习的未见噪音问题
Shao-Yuan Li1, Yu-Xiang Zheng2, Sheng-Jun Huang2
1MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, China; State Key Lab. for Novel Software Technology, Nanjing University, Nanjing, 211106, PR China; Joint Laboratory of Spatial Intelligent Perception and Large Model Application, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, PR China.
概括
本研究介绍了原型作为 (PAA),这是一种在线课程增量持续学习 (CIL) 的新方法,可以有效地处理噪音标签和未知的课程. 在动态环境中,PAA显著提高了模型性能和稳定性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机科学 计算机科学
背景情况:
- 阶级增量持续学习 (CIL) 模型难以适应不断变化的领域,特别是当面对杂的数据流时.
- 现有的CIL方法通常假定闭合式噪声,这是一个不切实际的场景,噪声只涉及已知的类.
- 现实世界的数据流可以包含开放式噪声,引入未见的类并进一步复杂化模型适应.
研究的目的:
- 在CIL的背景下,制定和分析封闭式和开放式噪声.
- 提出一种新的方法,即原型作为 (PAA),能够在在线CIL期间处理杂的标签和未知类.
- 在动态,现实世界的学习环境中增强模型的稳定性和性能.
主要方法:
- 制定和分析封闭式和开放式噪声,突出其对未见类的分类器的影响.
- 原型作为 (PAA) 的引入,一种基于重复的方法,利用类原型来在表示空间中表达.
- 实现双分类器架构,并进行一致性检查,以确保可靠的学习.
主要成果:
- 已证明PAA能够有效地区分和减轻由开放式噪声引入的未见类的影响.
- 与现有的CIL方法相比,在各种数据集中显著改善了模型性能和稳定性.
- 验证PAA在动态,不断变化的数据流中处理噪音标签的有效性.
结论:
- 在现实的噪音标签和未知类的存在下,PAA为在线课程增量持续学习提供了一个有希望的解决方案.
- 该方法能够学习歧视性原型并采用基于相似性的denoising,提高了模型的适应性.
- 在动态,现实世界的应用中,PAA为持续学习提供了一个强大的框架.
相关概念视频
Observational Learning
321
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
321
Introduction to Learning
551
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
551
Cognitive Learning
668
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
668
Purposive Learning
210
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
210
Associative Learning
605
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
605
The Anchoring-and-Adjustment Heuristic
7.4K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.4K

