小脑爬纤维信号灵活,快速适应奖励预测
bioRxiv : the preprint server for biology
|October 17, 2024
概括
小脑中的爬行纤维 (CFs) 可以信号奖励预测错误,灵活适应新的奖励规则. 这些发现表明CF在强化学习中发挥着关键作用.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 大脑小叶的功能
背景情况:
- 经典模型将大脑爬纤维 (CFs) 视为监督运动学习的错误信号.
- 新出现的证据表明,CFs也可能编码奖励预测错误 (rPE),这对强化学习至关重要.
- 与奖励相关的CF反应的关键特性仍然不太了解,这阻碍了对小脑学习机制的洞察.
研究的目的:
- 研究CFs对普金尼细胞的后突触反应,以应对奖励预测性和非预测性刺激.
- 为了确定学习CF反应如何在各种刺激和感官模式中泛化.
- 评估学习CF应对变化的奖励意外情况的灵活性和适应性.
主要方法:
- 采用双光子成像来测量CFs的突触后反应.
- 脑小细胞的Purkinje细胞是记录的目标.
- 学习的刺激,无论是奖励预测或非预测,都被用于评估CF反应.
主要成果:
- 结核病患者在相同的感官模式内对类似的线索表现出普遍的反应,而不管奖励预测如何.
- 这种概括取决于时间上下文,并没有跨越不同的感官模式.
- 学习CF反应表现出灵活性,根据新的奖励意外情况快速更新.
结论:
- CF可以产生学习的,奖励预测的响应,这些响应是情境敏感的.
- 这些反应灵活,适应环境变化,支持强化学习的作用.
- 这些发现挑战了传统的监督学习模式,并突出了CF对基于奖励的自适应性学习的能力.
更多相关视频
相关概念视频
Diencephalon: Thalamus and Information Relay
1.5K
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological...
1.5K
Indirect Motor Pathways
1.4K
The indirect motor or extrapyramidal pathways originate in the brainstem, the lower portion of the brain that connects it to the spinal cord. They consist of several distinct tracts, each with specialized functions. The four main tracts of the indirect motor pathways are the vestibulospinal tract, the reticulospinal tract, the tectospinal tract, and the rubrospinal tract.
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
1.4K
Major Somatic Sensory Pathways
912
Sensory impulses related to touch, pressure, vibration, and proprioception from various body parts, such as the limbs, trunk, neck, and posterior head, travel to the cerebral cortex through the posterior column-medial lemniscus pathway. The pathway’s name derives from the two white-matter tracts that convey the impulses: the spinal cord's posterior column and the brainstem's medial lemniscus. First-order sensory neurons extend their axons into the spinal cord, forming the...
912
Cerebellum: Anatomical Regions
1.5K
The cerebellum, also known as the "little brain," is located in the posterior cranial fossa, inferior to the tentorium cerebelli and dorsal to the brainstem. It plays a significant role in motor control, coordination, and proprioception.
Cerebellar Structure
Externally, the cerebellum features a highly convoluted surface with numerous folia (narrow ridges) separated by shallow sulci (grooves). The cerebellum is divided into two hemispheres by a thin median structure known as the vermis....
Cerebellar Structure
Externally, the cerebellum features a highly convoluted surface with numerous folia (narrow ridges) separated by shallow sulci (grooves). The cerebellum is divided into two hemispheres by a thin median structure known as the vermis....
1.5K
Spinal Cord: Cross-sectional Anatomy
1.7K
The cross-sectional anatomy of the spinal cord offers a detailed view of its complex structure and function within the central nervous system. At the core of the spinal cord lies the gray matter, characterized by its butterfly or "H"-shaped appearance in cross-section. This central region is enveloped by white matter, with the overall structure divided into symmetrical halves by the dorsal median sulcus and the ventral median fissure.
Gray Matter and its Components
Central to the gray...
Gray Matter and its Components
Central to the gray...
1.7K
Hierarchy of Motor Control
2.5K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
2.5K


