结合继承者表示和演员批判方法的神经网络模型揭示了对表示的有效生物利用
Takayuki Tsurumi1, Kenji Morita1,2
1Physical and Health Education, Graduate School of Education, The University of Tokyo, Tokyo, Japan.
Frontiers in computational neuroscience
|December 12, 2025
概括
本研究探讨了如何在人工智能中使用连续表示 (SR) 来进行行动选择. 研究结果表明,大脑可能会使用多个状态表示来学习最佳行为.
科学领域:
- 计算神经科学是一种计算神经科学.
- 强化学习是一种强化学习.
- 动物行为 动物行为
背景情况:
- 国家代表对于目标导向的行为和环境适应至关重要.
- 连续表示 (SR) 是一种预测状态表示,作为动物大脑,特别是海马的大脑模型,引起了人们的注意.
- 以前的研究集中在SR计算上,对其在行动选择中的作用进行了有限的探索.
研究的目的:
- 研究利用SR在行动选择和学习最佳政策中的生物机制.
- 在演员-关键框架内使用SR构建和分析用于行为学习的神经网络模型.
- 探索SR与其他状态表示 (如一热编码) 的互补使用.
主要方法:
- 开发了包含连续表示 (SR) 的演员关键神经网络模型.
- 员工强化学习来评估模型的性能.
- 我们比较了SR对演员与批评者的影响,并与Q学习和SARSA进行对比.
主要成果:
- 在演员-批评模型中,在演员与批评者之间应用SR时,证明了SR的独特效应.
- 表明将SR与一热编码结合起来,可以实现利用这两种表示的优势进行学习.
- 观察到,条形体可能通过互补地使用多个状态表示来学习.
结论:
- 演员关键架构,凭借其生物可信性,适合模拟基于SR的行为学习.
- 将SR与一热编码等传统方法集成为增强强化学习提供了一个有希望的方法.
- 这些发现表明,在条纹体中,可能存在一种神经机制,用于整合各种状态表示来指导行为.
相关概念视频
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Neural Regulation
43.0K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
43.0K
Nonconscious Mimicry
5.1K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
5.1K
Neurons as Communicators of the Brain
2.8K
Neurons, the fundamental units of the brain and nervous system, function as the primary transmitters of information throughout the body. Their ability to communicate through electrical and chemical signals is vital for every bodily function, from regulating the heartbeat to processing complex thoughts. Each neuron has three main components: the cell body (soma), dendrites, and an axon, each specialized to facilitate swift and efficient neural communication.
Cell Body
The cell body, also known...
Cell Body
The cell body, also known...
2.8K
Actor-Observer Effect
302
The actor-observer effect, a cognitive bias closely linked to the fundamental attribution error, refers to the tendency for individuals to attribute their behavior to external, situational factors while explaining others’ behavior in terms of internal, dispositional traits. This asymmetry in attribution significantly influences social perception and judgment.Cognitive Mechanisms Behind the EffectTwo primary psychological mechanisms contribute to the actor-observer effect: differences in...
302
Neural Control of Respiration
4.4K
The neural regulation of respiration is a meticulously coordinated process primarily controlled by the respiratory centers located within the brainstem. These centers, composed of specialized neurons, transmit nerve impulses that control the contraction and relaxation of our respiratory muscles.
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...
4.4K


