人类小脑编码了暂时敏感的强化学习信号
Juliana E Trach1, Yiran Ou1, Samuel D McDougle1,2
1Dept of Psychology, Yale University, New Haven, CT 06510.
bioRxiv : the preprint server for biology
|September 15, 2025
概括
人类小脑在认知学习中发挥作用,特别是强化学习 (RL). 小脑RL信号是暂时敏感的,无法检测,反延迟超过1秒.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
背景情况:
- 小脑以运动学习而闻名,但也对非运动学习做出了贡献,包括强化学习 (RL).
- 之前在动物模型上的研究已经确定了小脑中的RL信号,但人类的计算约束仍然不清楚.
研究的目的:
- 使用计算驱动的fMRI研究研究人类小脑RL信号.
- 检查小脑RL信号的时间灵敏度及其网络连接性.
主要方法:
- 人类参与者完成了一个RL任务,没有感觉运动意外.
- 功能磁共振成像 (fMRI) 用于观察大脑活动.
- 操纵了反延迟以评估时间灵敏度.
主要成果:
- 在认知小脑区域 (Crus I和II) 发现了与奖励处理和预测错误相关的强有力的RL信号.
- 这些信号是暂时敏感的,在反延迟超过一秒时会消失.
- 脑小叶RL信号与腹部条纹体和海马体相比,显示出明显的时间敏感性.
- 连接性分析显示,在RL反过程中,认知小脑和前额叶皮层/尾状核之间的协同激活.
结论:
- 人类小脑通过暂时受限的RL信号为认知学习任务做出贡献.
- 这些发现有助于我们更好地理解小脑在非运动学习和决策中的作用.
相关概念视频
Timing and Consequences on Behavior
359
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
359
Role of Cerebellum and Prefrontal Cortex in Memory
1.1K
The cerebellum, while traditionally associated with motor control, also plays a crucial role in memory, particularly in procedural memory, which involves learning motor tasks that become automatic through repetition. For example, studies have shown that when the cerebellum is damaged, individuals or animals lose the ability to learn conditioned motor responses, such as the conditioned eye-blink response in classical conditioning experiments with rabbits. This study demonstrates the...
1.1K
Diencephalon: Thalamus and Information Relay
3.9K
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological...
3.9K
Major Somatic Sensory Pathways
2.4K
Sensory impulses related to touch, pressure, vibration, and proprioception from various body parts, such as the limbs, trunk, neck, and posterior head, travel to the cerebral cortex through the posterior column-medial lemniscus pathway. The pathway’s name derives from the two white-matter tracts that convey the impulses: the spinal cord's posterior column and the brainstem's medial lemniscus. First-order sensory neurons extend their axons into the spinal cord, forming the...
2.4K
Higher Mental Functions of Brain: Learning and Memory
1.9K
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
1.9K


