在 de novo 任务学习期间推断学习规则
Victor Geadah1, Jonathan W Pillow1,2
1Program in Applied and Computational Mathematics, Princeton University, NJ.
bioRxiv : the preprint server for biology
|November 19, 2025
概括
神经科学家开发了一种新的统计框架,以揭示动物如何从头开始学习新任务. 这种方法揭示了类似于政策梯度的学习规则,与标准的强化学习模型不同.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 动物行为 动物行为
背景情况:
- 识别管理行为的学习规则是神经科学的一个关键挑战.
- 强化学习 (RL) 提供了一个框架,但研究通常使用非静止环境,而不是新的学习.
- 了解动物如何获得全新的任务至关重要.
研究的目的:
- 引入一个统计框架,直接从单个动物行为中推断RL规则.
- 将类似于政策梯度的规则与经典的时间差异算法进行比较,用于新的任务学习.
- 发现动物学习中的标准RL模型的系统偏差.
主要方法:
- 开发了一个统计框架,从行为数据中推断RL规则.
- 将框架应用于小鼠学习感知决策任务.
- 将灵活的参数学习规则与行为数据相匹配.
主要成果:
- 类似于政策梯度的规则比时间差异算法更好地解释 de novo 任务学习.
- 识别了与标准RL的偏差,包括侧面特定学习率和负奖励基线.
- 发现动物在训练和课程之间动态地适应学习速度.
结论:
- 该框架提供了关于动物如何从头开始学习新任务的统计数据.
- 动物学习表现出与经典强化学习算法的关键偏离.
- 研究结果提供了关于适应性学习背后的神经机制的见解.
相关概念视频
Observational Learning
802
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
802
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Purposive Learning
426
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
426
Deductive Reasoning
63.7K
Deductive reasoning, or deduction, is the type of logic used in hypothesis-based science. In deductive reasoning, the pattern of thinking moves in the opposite direction as compared to inductive reasoning, which means that it uses a general principle or law to predict specific results. From those general principles, a scientist can deduce and predict the specific results that would be valid as long as the general principles are valid.
For example, a researcher can deduce specific predictions...
For example, a researcher can deduce specific predictions...
63.7K
Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K
Inductive Reasoning
64.5K
Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
64.5K


