前帯状皮質のフィクティブな報酬信号は,前帯状皮質にある
Benjamin Y Hayden1, John M Pearson, Michael L Platt
1Department of Neurobiology, Duke University School of Medicine, Center for Neuroeconomic Studies, Center for Cognitive Neuroscience, Duke University, Durham, NC 27701, USA. hayden@neuro.duke.edu
まとめ
前帯状皮質 (ACC) のニューロンは,選択されていない行動からの潜在的な報酬に関する情報を処理します. これは,ACCニューロンが,行動適応のための経験と架空の報酬信号の両方を統合することを示唆しています.
科学分野:
- 神経科学は神経科学である.
- 認知神経科学とは
- 意思決定 意思決定をする
背景:
- 潜在的結果から学習する脳の能力は,経験していないものであっても,適応的行動には極めて重要です.
- 前帯状皮質 (ACC) は,行動の結果を監視し,行動調整を導くことに関与しています.
- 架空の結果の処理の基礎となる神経機構は,依然としてほとんど不明である.
研究 の 目的:
- 前帯状皮質 (ACC) のニューロンが架空の報酬情報に反応するかどうかを調査する.
- ACCニューロンが,行われていない行動からの結果の値をコードしているかどうかを判断する.
主な方法:
- シングルニューロンの記録は,選択タスクの際にACCで行われました.
- タスクデザインは,選択されていないオプションに関連付けられた報酬値に関する明示的な情報を提供しました.
- 神経活動の分析は,選択された行動と非選択された行動の両方の結果に関連して行われました.
主要な成果:
- ACCニューロンは,架空の報酬情報に対する有意な反応を示した.
- ACCニューロンによる架空の報酬のコード化スキームは,経験的な報酬のコード化スキームと似ています.
- 個々のACCニューロンは,経験と架空の報酬信号の両方を処理することが判明しました.
結論:
- 前帯状皮質 (ACC) は,潜在的,未経験的な結果に関する情報を処理する役割を果たします.
- ACCニューロンは,経験と架空の報酬信号の両方を統合し,結果評価のための統一されたメカニズムを示唆します.
- これらの発見は,不確実性下での学習と意思決定のニューラル基盤についての理解を深める.
関連する概念動画
Primary and Secondary Reinforcers
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Association Areas of the Cortex
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Facial Feedback Hypothesis
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...
Incentive Theory: Pull Theory of Motivation
Incentive theory, or the "pull theory" of motivation, suggests that external rewards primarily drive behavior. Individuals are motivated to engage in activities when they anticipate a desirable outcome. This is why people often work hard for promotions or study intensively to achieve high grades. These incentives can be tangible, physical rewards such as money or promotions, or intangible, non-physical rewards like praise and social recognition.
The theory differentiates between intrinsic and...
The theory differentiates between intrinsic and...
Diencephalon: Anatomical Regions
The diencephalon, etymologically translated as 'through brain,' plays an integral role as the conduit between the cerebrum and the vast extent of the nervous system. However, the olfactory system is an exception, as it interfaces directly with the cerebrum. The diencephalon, deeply ensconced beneath the cerebrum, primarily consists of three paired structures — the thalamus, hypothalamus, and epithelamus. It also includes accessory structures such as the subthalamus, which houses the subthalamic...


