相关实验视频
Updated: Jan 10, 2026

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
11.4K
在强化学习中赋予学分的解剖学基质
J Kornfeld1,2,3,4, Y Wang5, M Januszewski6
1MRC Laboratory of Molecular Biology, Francis Crick Avenue, Cambridge Biomedical Campus, Cambridge CB2 0QH, UK.
bioRxiv : the preprint server for biology
|November 24, 2025
概括
这项研究揭示了歌鸟大脑如何实现学分分配,这是一个至关重要的学习过程. 基底质中的轴突连接支持一种生物学上可信的强化学习模型,与人工智能方法不同.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
背景情况:
- 信用分配是生物和人工学习系统的一个基本挑战.
- 目前的人工智能依赖于反向传播,缺乏明确的生物相关性.
- 基底腺参与学习,但学分分配的机制尚不清楚.
研究的目的:
- 为了研究歌鸟基底 (X区域) 的突触架构,以进行局部信用分配.
- 测试生物系统中强化学习的节点扰动模型的预测.
- 基于详细的神经数据开发强化学习的生物物理模型.
主要方法:
- 使用两个体积电子显微镜 (vEM) 数据集进行自动化连接原子分析.
- 轴突终结模式与模型预测的比较.
- 强化学习的生物物理模型的构建.
主要成果:
- 在X区的Synaptic架构支持通过节点扰动算法变体通过本地信用分配.
- 编码探索性变异性的轴突在树突轴上结束.
- 编码歌曲时间 (上下文) 的轴突终结在树突上.
- 一个生物物理模型证明了这种突触二分法所促进的高效学习.
结论:
- 这些发现提供了强有力的证据,证明在脊椎动物的基底格里亚中具有生物可信度的信用分配模型.
- 这个模型提供了一个潜在的学习机制,与人工智能反向传播不同.
- 这项研究强调了突触架构在启用大脑中复杂的计算功能的作用.
相关概念视频
Observational Learning
802
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
802
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Instinctive Drift
613
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
613
Reinforcement Schedules
438
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
438
Law of Effect
2.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
2.4K
Reinforcement
797
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
797

