在前额叶皮层和循环神经网络中逆向学习的神经动力学
bioRxiv : the preprint server for biology
|October 7, 2024
概括
皮层神经元代表使用稳定状态转向概率,在学习过程中过渡到动态活动. 这种神经表示对于指导概率逆转学习任务中的行为至关重要.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 概率逆转学习涉及适应变化的奖励概率.
- 最佳性能需要推断一个逆转事件的概率.
- 了解这种概率的神经表示是关键.
研究的目的:
- 调查逆转概率是如何被编码在前额叶皮质.
- 分析子的神经活动,训练反复性神经网络.
- 阐明反向概率表示的动态.
主要方法:
- 在进行逆向学习的子中分析前额叶皮层的神经活动.
- 在同一个任务上训练经常性神经网络.
- 将预测模型与神经数据相匹配.
- 在网络中扰乱神经活动以评估功能意义.
主要成果:
- 神经活动编码在特定子空间内的逆转概率,整合奖励结果.
- 在试验开始时,活动显示了一个稳定,静止的状态,与线吸引器模型一致.
- 在试验过程中,活动变得非静止,与任务相关,偏离吸引力.
- 静态状态作为非静态动态的初始条件.
- 非静止轨迹是可分离的,代表着不同的概率值.
- 网络中的干扰表明了反转概率活动的功能作用.
结论:
- 皮层网络编码在稳定的初始状态下反转概率.
- 这种状态启动了适应任务行为的非静止动态.
- 延长线吸引器模型捕捉了这些动态,突出了功能意义.
相关概念视频
Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
Neuroplasticity
309
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
309
Long-term Potentiation
54.9K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
54.9K
Instinctive Drift
193
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
193
Role of Cerebellum and Prefrontal Cortex in Memory
381
The cerebellum, while traditionally associated with motor control, also plays a crucial role in memory, particularly in procedural memory, which involves learning motor tasks that become automatic through repetition. For example, studies have shown that when the cerebellum is damaged, individuals or animals lose the ability to learn conditioned motor responses, such as the conditioned eye-blink response in classical conditioning experiments with rabbits. This study demonstrates the...
381


