海马体支持在部分可观测性下进行多任务强化学习
Dabal Pedamonti1,2, Samia Mohinta1,3, Martin V Dimitrov1
1Computational Neuroscience Unit, Intelligent Systems Labs, Faculty of Engineering, University of Bristol, Bristol, UK.
Nature communications
|October 31, 2025
概括
这项研究表明,具有模拟海马回路的人工智能代理可以学习复杂的导航任务,类似于动物学习的方式. 这突显了海马在强化学习中发挥的作用,以在不可预测的环境中生存.
科学领域:
- 神经科学是一个神经科学.
- 人工智能的人工智能
- 计算生物学 计算生物学
背景情况:
- 海马与导航有关,但其在现实世界学习中的确切功能尚未完全理解.
- 了解海马的功能是解释目标导航和生存策略的关键.
研究的目的:
- 研究海马电路在强化学习 (RL) 中的作用,用于在部分可观测环境中的导航.
- 使用深度RL代理来建模动物行为和神经数据.
主要方法:
- 在部分可观测的环境中使用自我中心和非中心的任务训练深度RL代理人.
- 与具有反复的海马回路到前网络的药物进行了比较.
- 用于代理代表的尺寸缩小,并与大鼠海马记录进行验证.
主要成果:
- 具有海马回路的代理人学习了与动物行为一致的任务,与前网络不同.
- 从代理人提取的表示 (奖励,策略,时间) 反映了实验结果.
- 海马RL代理显示出对新条件的更好的概括,并预测了特定状态的轨迹.
结论:
- 在自然,部分可观测的环境中,反复出现的海马网络对于有效的RL至关重要.
- 这些发现支持海马在促进自适应导航和学习方面发挥着重要作用.
- 这项研究将计算建模与经验神经科学联系起来,以解释海马功能.
相关概念视频
Observational Learning
807
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
807
Role of Hippocampus in Memory
1.4K
The hippocampus, a critical brain structure, plays an essential role in memory processing, particularly in the formation and retrieval of memory. This small, seahorse-shaped region is located within the medial temporal lobe, with one hippocampus in each brain hemisphere. Experimental studies involving lesions in the hippocampi of rats have demonstrated significant impairments in tasks such as object recognition and maze navigation, indicating the hippocampus involvement in both recognition and...
1.4K
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Reinforcement
810
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
810
Cognitive Learning
991
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
991
Reinforcement Schedules
442
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
442


