在随机学习过程中延迟结果的信用分配的神经机制
Phillip P Witkowski1,2,3, Lindsay J H Rondot1,2, Zeb Kurth-Nelson4
1Center for Mind and Brain, University of California Davis, Davis, United States.
eLife
|April 15, 2025
概括
这项研究揭示了大脑如何为过去的行为赋予信誉,确定侧轨道前皮层 (lOFC) 和海马体 (HC) 是将选择与结果联系起来的关键,即使有延迟. 侧面前极皮质 (lFPC) 通过保留待定选择来帮助学习.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 决策 决策 决策 决策
背景情况:
- 适应性行为需要将行动与结果联系起来.
- 对于特定的信用分配的神经机制仍然不清楚.
研究的目的:
- 研究特定信用分配的神经机制.
- 了解大脑如何将延迟的选择与结果联系起来.
- 确定参与学习选择结果关系的大脑区域.
主要方法:
- 对fMRI数据的多变量模式分析.
- 适应式学习任务设计.
- 在信用分配过程中分析神经表征.
主要成果:
- 横向轨道前皮层 (lOFC) 和海马体 (HC) 编码因果选择认同延迟结果.
- 侧面前极皮层 (lFPC) 支持在临时决策发生时的学习.
- lFPC持有悬而未决的选择,其表示忠诚度预测了lOFC/HC忠诚度.
结论:
- 在LOFC和HC中及时恢复特定原因对于学习选择结果关系至关重要.
- lFPC在延迟和临时决定期间保持选择信息方面发挥着作用.
- 这些发现有助于我们更好地理解复杂的学习和决策的神经基础.
相关概念视频
Cognitive Learning
97
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
97
Purposive Learning
90
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
90
Real-World Application of Classical Conditioning
477
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
477
Instinctive Drift
160
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
160
Associative Learning
246
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
246
Higher Mental Functions of Brain: Learning and Memory
536
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
536


