相关实验视频
Updated: Sep 15, 2025
12:09
Studying Food Reward and Motivation in Humans
Published on: March 19, 2014
23.7K
好奇心和快乐的价值对强化学习的分离效应
bioRxiv : the preprint server for biology
|July 16, 2025
概括
由于对新奇事物的乐观信念,子在损失可能时更多地探索不确定的选择. 瓦伦斯影响了从损失和决策中学习,揭示了独特的好奇心和动机效应.
科学领域:
- 神经科学是一个神经科学.
- 行为经济学是一种行为经济学.
- 认知科学 认知科学
背景情况:
- 好奇心和探索对于在不确定性下学习和决策至关重要.
- 结果价值 (正与负) 对跨物种的探索策略的影响尚未完全理解.
- 以前的人类研究通常依赖于明确的指令,限制了对经验驱动探索的洞察力.
研究的目的:
- 为了研究快乐的价值如何影响新奇的寻找,探索和强化学习在 rhesus macaques.
- 要确定取决于价值的探索是出于好奇心还是先前的信念.
- 检查方法和避免动机在学习和决策中的作用.
主要方法:
- rhesus 被研究使用视觉标记作为二次增强剂.
- 探索新的,不确定的选择,比较预测收益和损失的条件.
- 分析了强化学习,选择杆和定向与随机探索.
主要成果:
- 子在结果涉及与收益相比的潜在损失时,增加了寻求新奇性的表现.
- 增加的新奇寻找被归因于对新奇的前期乐观信念,而不是对好奇心的直接价值效应.
- 子更快地从损失中学习,而不是从收益中学习,这表明它们厌恶损失.
- 选择作为战略反应,以解决 - - 避免冲突和不确定性,调节勘探.
结论:
- 享乐的价值观不会彻底改变好奇心,而是通过先前的信念和动机状态来影响探索.
- 方法和避免动机对强化学习和决策策略有不同的影响.
- 这些发现揭示了好奇心和价值对探索-利用权衡和适应性行为的分离效应.
相关概念视频
01:21Cognitive Learning
539
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
539
01:05Instinctive Drift
329
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
329
01:23Primary and Secondary Reinforcers
414
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
414
01:24Generalization, Discrimination, and Extinction
813
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
813
01:28Behaviorism
2.7K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.7K
01:22Purposive Learning
208
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
208