小脑有助于人类强化学习中的预测错误编码
Dana M Huvermann1,2, Adam M Berlijn2,3, Andreas Thieme4
1Department of Neurology and Center for Translational and Behavioral Neurosciences (C-TNBS), Essen University Hospital, University of Duisburg-Essen, Essen, Germany danamaria.huvermann@uk-essen.de dana.huvermann@hhu.de.
概括
小脑对于人类大脑中强化学习预测错误 (RL-PE) 处理至关重要. 通过中风或TMS破坏小脑功能,会使前脑区域的RL-PE信号变得麻木.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
背景情况:
- 小脑传统上与感官预测错误 (PE) 处理有关.
- 最近的动物研究表明小脑参与了强化学习预测错误 (RL-PE).
- 小脑在人类RL-PE处理中的作用仍然不清楚.
研究的目的:
- 调查小脑输出是否对于人类前脑区域的RL-PE处理至关重要.
- 确定小脑对行动结果学习和RL-PE编码的必要性.
主要方法:
- 两项互补的人体实验使用脑电图 (EEG) 和概率反学习任务.
- 实验1:对比RL-PE处理 (通过反相关的消极性-FRN) 在小脑中风患者与健康对照.
- 实验2:使用单脉冲小脑跨磁性刺激 (TMS) 在健康参与者中产生暂时的"虚拟损伤".
主要成果:
- 行动结果关联的行为学习在很大程度上保持不变,对灵活性的影响很小.
- 在小脑中风患者中没有发现显著的RL-PE处理 (FRN).
- 大脑小叶TMS还消除了健康参与者的显著RL-PE处理.
- 当小脑输出受到损害时,前脑RL-PE编码明显变得.
结论:
- 大脑小脑输出对于人类前脑区域的RL-PE处理是必要的.
- 这些发现扩展了动物数据,支持小脑在RL-PE处理中的直接作用.
- 小脑对于前脑中的RL-PE编码至关重要.
相关概念视频
Role of Cerebellum and Prefrontal Cortex in Memory
292
The cerebellum, while traditionally associated with motor control, also plays a crucial role in memory, particularly in procedural memory, which involves learning motor tasks that become automatic through repetition. For example, studies have shown that when the cerebellum is damaged, individuals or animals lose the ability to learn conditioned motor responses, such as the conditioned eye-blink response in classical conditioning experiments with rabbits. This study demonstrates the...
292
Cognitive Learning
114
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
114
Diencephalon: Thalamus and Information Relay
1.3K
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological...
1.3K
Associative Learning
270
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
270
Cerebellum: Anatomical Regions
1.4K
The cerebellum, also known as the "little brain," is located in the posterior cranial fossa, inferior to the tentorium cerebelli and dorsal to the brainstem. It plays a significant role in motor control, coordination, and proprioception.
Cerebellar Structure
Externally, the cerebellum features a highly convoluted surface with numerous folia (narrow ridges) separated by shallow sulci (grooves). The cerebellum is divided into two hemispheres by a thin median structure known as the vermis....
Cerebellar Structure
Externally, the cerebellum features a highly convoluted surface with numerous folia (narrow ridges) separated by shallow sulci (grooves). The cerebellum is divided into two hemispheres by a thin median structure known as the vermis....
1.4K
Higher Mental Functions of Brain: Learning and Memory
603
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
603


