强化学习,当你的生活取决于它:学习的神经经济理论的学习
Jiamu Jiang1, Emilie Foyard1, Mark C W van Rossum1,2
1School of Mathematical Sciences, University of Nottingham, Nottingham, United Kingdom.
PLoS computational biology
|October 28, 2024
概括
为了生存,动物必须平衡学习和生存的能量使用. 这项研究表明,根据能量水平切换记忆路径可以优化学习并延长模拟的寿命.
科学领域:
- 神经科学是一个神经科学.
- 计算生物学 计算生物学
- 动物行为 动物行为
背景情况:
- 突触可塑性对于适应至关重要,但在代谢上昂贵.
- 学习决策涉及能源投资和生存之间的神经经济权衡.
- 在饥饿期间,Drosophila melanogaster抑制了能量密集的记忆形成.
研究的目的:
- 研究能量储备在调节记忆形成和学习中的作用.
- 为了模拟在能源限制下学习的神经经济困境.
- 为了确定适应性记忆路径切换是否提高了生存率.
主要方法:
- 开发了一个强化学习框架来模拟的行为.
- 能源考虑被整合到突触可塑性模型中.
- 模拟的学会了使用长期记忆 (LTM) 和耐麻醉记忆 (ARM) 途径来避免有害刺激.
- 寿命最大化是主要目标,使用危险函数建模.
主要成果:
- 在LTM和ARM路径之间动态切换的策略延长了模拟寿命.
- 切换行为取决于能量储备水平和奖励预测错误.
- 记忆路径的能量调节对于适应性学习至关重要.
结论:
- 能量的可用性显著影响了记忆路径的调节.
- 记忆系统之间的自适应切换优化了在资源限制下生存的学习.
- 这些发现对理解生物学习和设计强化学习系统有重要意义.
相关概念视频
Cognitive Learning
222
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
222
Purposive Learning
101
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
101
Timing and Consequences on Behavior
82
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
82
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K
Avoidance Learning and Learned Helplessness
1.7K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.7K
Reinforcement
181
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
181


