不同的值计算支持快速的顺序决策
Andrew Mah1, Shannon S Schiereck1, Veronica Bossio1,2
1Center for Neural Science, New York University, New York, NY, 10003, USA.
Nature communications
|November 21, 2023
概括
老鼠使用不同的价值计算来进行连续的决策,根据环境价值调整试验启动和奖励等待时间. 这揭示了不同价值计算如何在大脑中动态相互作用.
科学领域:
- 神经科学是一个神经科学.
- 动物行为 动物行为
- 计算神经科学是一种神经科学.
背景情况:
- 环境价值影响动物的动机和学习.
- 强化学习模型通过经验或模拟来解释价值计算.
- 一个关键的问题是神经系统如何选择或结合不同的价值计算策略.
研究的目的:
- 为了研究老鼠如何计算单个试验中的顺序决策的环境值.
- 了解在快速时间尺度上的不同值计算之间的相互作用.
主要方法:
- 在一个具有隐藏奖励状态的时间注任务中,对291只老鼠进行高通量训练.
- 统计建模用于分析行为数据和价值计算.
- 观察试验启动和奖励等待时间的调整.
主要成果:
- 鼠在开始试验时与等待奖励时计算环境值的不同.
- 价值估计是动态交互的,受到动态学习率的影响.
- 行为调整反映了成本 (努力,时间) 和预期回报之间的平衡.
结论:
- 不同的值计算被老鼠用来在几秒钟内做出连续的决定.
- 值计算的相互作用是动态的,通过学习速率进行调制.
- 高通量训练对于研究动物复杂的认知行为是有效的.
相关概念视频
Decision Making: P-value Method
5.4K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.4K
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
3.1K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
3.1K
Decision Making: Traditional Method
4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K
Per-Unit Sequence Models
75
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
75
Rate-Determining Steps
32.5K
Relating Reaction Mechanisms
In a multistep reaction mechanism, one of the elementary steps progresses significantly slower than the others. This slowest step is called the rate-limiting step (or rate-determining step). A reaction cannot proceed faster than its slowest step, and hence, the rate-determining step limits the overall reaction rate.
The concept of rate-determining step can be understood from the analogy of a 4-lane freeway with a short-stretch of traffic-bottleneck caused due to...
In a multistep reaction mechanism, one of the elementary steps progresses significantly slower than the others. This slowest step is called the rate-limiting step (or rate-determining step). A reaction cannot proceed faster than its slowest step, and hence, the rate-determining step limits the overall reaction rate.
The concept of rate-determining step can be understood from the analogy of a 4-lane freeway with a short-stretch of traffic-bottleneck caused due to...
32.5K
Reason and Intuition
6.5K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.5K


