关于小脑学习的理论,即在连续的时间和空间中以尖为基础的强化学习
Rin Kuriyama1, Hideyuki Yoshimura2, Tadashi Yamazaki1
1Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo 182-8585, Japan.
PNAS nexus
|October 2, 2025
概括
这项研究引入了强化学习 (RL) 的小脑尖端网络模型,挑战了小脑仅仅是监督学习机器的观点. 该模型成功地学习了任务,证明了其RL能力.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 通过长期抑郁 (LTD) 建立了小脑在监督学习中的作用.
- 新出现的证据表明,协同的可塑性机制增强了小脑学习.
- 一个概念框架将小脑视为一种强化学习 (RL) 机器.
研究的目的:
- 弥合概念RL算法和它们在小脑中的详细实现之间的差距.
- 为RL开发和验证一个生物学上可信的小脑刺网络模型.
- 挑战关于小脑仅仅是监督学习系统的经典观点.
主要方法:
- 在连续的时间和空间中实现小脑刺网络模型.
- 将小脑已知的解剖特征纳入模型.
- 在标准的RL基准上测试模型,如山车任务和延迟眼调节.
主要成果:
- 该模型成功地学习了状态值.
- 该模型解决了山地汽车任务,这是一个共同的RL基准.
- 该模型使用生物学上可信的动态证明了在延迟眼条件化任务中的熟练程度.
结论:
- 发达的小脑刺网络作为一个强大的RL模型.
- 这项研究为小脑RL理论提供了坚实的基础.
- 这些发现挑战了关于小脑在学习中的作用的传统观点.
相关概念视频
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Observational Learning
838
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
838
Cognitive Learning
1.0K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.0K
Higher Mental Functions of Brain: Learning and Memory
1.9K
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
1.9K
Introduction to Learning
954
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
954
Reinforcement Schedules
459
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
459


