课程效应和构成性随着中文学习在神经网络中出现
Jacob Russin1, Ellie Pavlick2, Michael J Frank3
1Department of Computer Science, Department of Cognitive and Psychological Sciences, Brown University.
ArXiv
|February 27, 2024
概括
具有上下文学习 (ICL) 的神经网络可以模仿人类的学习二元性. 它们展示了结构化任务的基于规则的学习和非结构化任务的增量学习,协调了双流程理论.
科学领域:
- 认知科学 认知科学
- 人工智能的人工智能
- 神经科学是一个神经科学.
背景情况:
- 人类的学习表现出一种二元性:基于规则的和渐进的. 心理学理论为这些行为提出了不同的学习系统.
- 神经网络传统上通过权重更新模拟增量学习,努力解释基于规则的学习.
研究的目的:
- 调查是否能够进行上下文学习 (ICL) 的神经网络可以复制人类的学习二元性.
- 将人类学习的双过程理论与神经网络能力相协调.
主要方法:
- 利用超学习神经网络和能够进行上下文学习 (ICL) 的大型语言模型.
- 对规则治理和非结构化任务的评估网络性能,与人类行为数据进行比较.
- 在上下文学习 (ICL) 和权重学习 (IWL) 机制之间进行区分.
主要成果:
- 与ICL的网络展示了在规则治理任务上类似人类的组成学习.
- 这些网络还通过IWL在非结构化任务上复制了人类的试错学习.
- 神经网络中的新兴ICL与IWL一起提供了独特的学习特性.
结论:
- 语境学习 (ICL) 赋予神经网络灵活的学习能力,弥合了基于规则和增量学习之间的差距.
- 这使双过程理论与神经网络模型相协调,为认知灵活性提供了新的视角.
- ICL和IWL可以在神经网络中共存,反映人类的双重学习系统.
相关概念视频
Associative Learning
362
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
362
Neural Circuits
1.2K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.2K
Higher Mental Functions of Brain: Learning and Memory
799
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
799
Neuroplasticity
359
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
359
Real-World Application of Classical Conditioning
562
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
562
Cognitive Learning
243
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
243


