决策和强化学习计算参数的可靠性
Anahit Mkrtchian1,2, Vincent Valton1, Jonathan P Roiser1
1Neuroscience and Mental Health Group, Institute of Cognitive Neuroscience, University College London, London, United Kingdom.
Computational psychiatry (Cambridge, Mass.)
|May 22, 2024
概括
学习和决策的计算模型显示可靠的个体指标. 这些发现支持它们在精密精神病学中的应用,以了解和治疗精神疾病.
科学领域:
- 认知神经科学 认知神经科学
- 计算精神病学是一种计算精神病学.
背景情况:
- 计算模型为认知提供了机械的洞察力,这对于精神疾病研究至关重要.
- 可靠的计算措施对于成功的翻译精神病学研究至关重要.
研究的目的:
- 评估强化学习和经济模型在捕捉个体特征方面的可靠性.
- 评估精密精神病学计算参数的翻译潜力.
主要方法:
- 50名健康的个体完成了一项不安的四臂强盗和一个校准的博任务两次,两周间隔.
- 强化学习和前景理论模型是从任务绩效数据中得出的.
- 评估了模型参数 (学习率,敏感性,风险/损失厌恶) 的可靠性.
主要成果:
- 强化学习参数显示出良好的可靠性.
- 前景理论参数 (风险和损失厌恶) 显示出良好的可靠性.
- 两种模型都预测了未来的个体行为,个性化的参数产生了更好的预测.
结论:
- 从这些任务中获得的强化学习和前景理论参数可靠地测量.
- 这些可靠的计算参数可以评估学习和决策机制.
- 这些发现支持精准精神病学计算参数的翻译潜力.
相关概念视频
Reason and Intuition
6.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.4K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
50
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
50
Decision Making
106
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
106
Cognitive Learning
237
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
237
Timing and Consequences on Behavior
88
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
88


