奖励重置间隔定时驱动器通过dorsomedial条形体的神经状态过渡进行补丁食决策
Elissa Sutlief1, Shichen Zhang1, Kate Foresberg1
1Department of Neuroscience, Johns Hopkins University School of Medicine, 725 N. Wolfe Street, Baltimore, MD 21205, USA.
bioRxiv : the preprint server for biology
|November 19, 2025
概括
大脑是大脑的大脑.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 行为经济学是一种行为经济学.
背景情况:
- 减少回报活动需要平衡结果评估和时间跟踪.
- 大脑的决策回路用于切换追求仍然不清楚.
- 背中条体 (DMS) 参与决策和间隔时间,对于食至关重要.
研究的目的:
- 调查大脑如何决定何时在收益下降的活动之间切换.
- 了解在寻找食物时的时间投资策略背后的神经机制.
- 检查背中条体 (DMS) 在整合时间和行动选择中的作用.
主要方法:
- 在一次补丁食任务期间,在小鼠的DMS中记录了细胞外神经元活动.
- 利用纤维光度测量在DMS中测量多巴胺信号.
- 分析了与奖励和退出决策有关的神经元发射率过渡和人口活动模式.
主要成果:
- 小鼠使用"奖励重置"策略,退出决策受到自上次奖励以来的时间,补丁居住地和环境环境的影响.
- 个别的DMS神经元在奖励后显示了离散的发射率转换,从而产生了全人口级的累积信号.
- DMS中的多巴胺信号编码了奖励预测错误,反映了随着时间的推移奖励概率的下降.
结论:
- 该DMS集成了间隔时间和行动选择,以指导食决策.
- 在DMS中的人口活动形成了一个时间信号,告知补丁退出时间.
- 在DMS中多巴胺信号传递有助于评估在食期间奖励概率下降的情况.
相关概念视频
Timing and Consequences on Behavior
338
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
338
Reinforcement Schedules
438
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
438


