当超级学习与在线和持续学习相遇时:一项调查
IEEE transactions on pattern analysis and machine intelligence
|September 18, 2024
概括
这篇论文调查了元学习,持续学习和在线学习框架. 它澄清了复杂的术语和问题设置,以帮助研究人员推进这些"学习学习"方法.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 深度神经网络已经在大型数据集上实现了小批次随机梯度下降的成功.
- 研究正在将神经网络应用扩展到新的学习场景,如元学习,持续学习和在线学习.
- 这些框架专注于优化学习算法和使用流数据增量模型更新,最初是单独开发的.
研究的目的:
- 提供对超级学习,持续学习和在线学习的全面调查.
- 在这些框架内使用一致的术语和正式描述来组织各种问题设置.
- 为了澄清这些先进的机器学习范式之间的区别和关系.
主要方法:
- 系统地审查和组织关于元学习,持续学习和在线学习的现有文献.
- 开发统一的术语和问题设置的正式描述.
- 分析这些学习框架的组合和交叉点.
主要成果:
- 一个结构化的概述,对元学习,持续学习和在线学习中的各种问题设置进行分类.
- 澄清这些学习范式之间的复杂性和区别.
- 识别研究这些框架的组合的最新研究.
结论:
- 这篇论文通过提供一致的术语和正式描述,促进了对复杂的学习框架的更清晰的理解.
- 这份有组织的概述旨在减少混,并鼓励该领域的进一步研究和进步.
- 通过促进清晰度,这项工作支持在元学习,持续学习和在线学习中开发新的问题设置和学习算法.
相关概念视频
Metacognition
142
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
142
Surveys
14.7K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.7K
Types of Surveys
37
Surveys are essential for marking property boundaries near water bodies. Different types of surveys are defined, each with its own function. Land surveys mark the property boundaries, while route surveys determine the position of properties on nearby highways. Topographic surveys create maps by capturing the three-dimensional features of the land. Hydrographic surveys focus on the shapes of underwater areas and the movement of streams through the properties. Mine surveys determine the relative...
37
Associative Learning
309
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
309
Observational Learning
149
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
149
Cognitive Learning
229
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
229


