不确定性和奖励历史对胜利和失败后的决策有不同的影响
bioRxiv : the preprint server for biology
|September 2, 2025
概括
动物通过反来学习, 但它们如何衡量胜利与失败仍然不清楚. 这项研究表明,不确定性和奖励历史影响了这种学习不对称性,在老鼠中观察到性别特异性的影响.
科学领域:
- 神经科学
- 行为科学
- 计算神经科学
背景情况:
- 智能行为依赖于自适应反集成.
- 动物从积极和消极反中表现出不对称的学习.
- 对于获利和损失的差异加权的基础计算是不太了解的.
研究的目的:
- 研究不确定性和奖励历史如何调节老鼠中胜负的权重.
- 提出并测试一个强化学习模型,包括不确定性和奖励历史.
- 了解动物适应环境变化的行为策略.
主要方法:
- 使用具有可变奖励可预测性的动态概率逆转学习任务.
- 收集来自老鼠的行为数据.
- 开发了一个强化学习模型,整合了未签名的平均奖励预测错误和主观奖励历史.
主要成果:
- 不确定性历史和奖励历史都显著影响了老鼠对胜利和失败的敏感性.
- 在具有低不确定性的可预测环境中,老鼠的权重胜率高于损失 (胜率较高,损失率较低).
- 发现性别差异:雄性老鼠的减班决策受奖励历史的影响更大,而雌性老鼠的不确定性历史影响更大.
结论:
- 赢和输的不对称权重是适应变化的奖励和不确定性的关键策略.
- 不确定性估计和奖励历史估计在调节行为适应方面发挥着不同的作用.
- 性别特定的神经计算有助于适应性学习策略.
更多相关视频
相关概念视频
Hindsight Biases
3.9K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
3.9K
Timing and Consequences on Behavior
152
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
152
Reason and Intuition
6.9K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.9K
Fundamental Attribution Error
13.2K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
13.2K
Decision Making: P-value Method
5.7K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.7K
Decision Making
228
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
228


