Related Experiment Video
Updated: Oct 25, 2025
06:11
A Conflict Model of Reward-seeking Behavior in Male Rats
Published on: February 20, 2019
7.6K
Impulsivity and risk-seeking as Bayesian inference under dopaminergic control
John G Mikhael1,2, Samuel J Gershman3,4
1Program in Neuroscience, Harvard Medical School, Boston, MA, USA. john_mikhael@hms.harvard.edu.
Summary
Bayesian models explain how dopamine (DA) influences decisions by adjusting reliance on stimulus versus context. Higher DA typically reduces impulsivity, but decreased temporal precision can reverse this effect, impacting reward-seeking behaviors.
Area of Science:
- Neuroscience
- Behavioral Economics
- Computational Psychiatry
Background:
- Dopamine (DA) plays a crucial role in decision-making, particularly in reward-based tasks.
- Bayesian models offer a framework for understanding how DA modulates cognitive processes like interval timing and reward estimation.
- Existing models suggest tonic DA levels influence the precision of stimulus encoding relative to contextual information.
Purpose of the Study:
- To extend Bayesian models of dopamine function to intertemporal choice and probability discounting tasks.
- To investigate how DA levels and temporal precision interact to influence choices between immediate and delayed, or certain and risky rewards.
- To predict and explain empirical findings related to impulsivity and risk-seeking behavior.
Main Methods:
- Utilized a Bayesian modeling approach to simulate decision-making processes.
- Applied the model to analyze intertemporal choice (small/soon vs. large/later rewards) and probability discounting (small/certain vs. large/risky rewards).
- Derived predictions regarding the effects of dopamine levels and temporal precision on choice behavior.
Main Results:
- The model predicts that increased dopamine generally promotes selection of larger/later and large/risky options, consistent with reduced impulsivity and increased risk-seeking.
- Crucially, sufficiently decreased temporal precision can invert these effects, leading to increased impulsivity and risk-aversion.
- The model also predicts preference reversals at high dopamine levels and suggests that improved temporal precision, independent of dopamine, favors delayed/risky choices.
Conclusions:
- Bayesian models provide a unified account for dopamine's complex effects on intertemporal choice and probability discounting.
- Temporal precision emerges as a critical factor interacting with dopamine levels to shape decision-making under uncertainty.
- The findings highlight the nuanced role of dopamine in regulating impulsivity and risk preferences, challenging simpler interpretations.
Related Concept Videos
01:28Human Genetics
901
Human genetics provides a profound framework for understanding the interplay between genetic predispositions and human psychology. At the heart of this discipline lies the study of how genes influence physical traits, behaviors, and susceptibility to diseases. Each person carries a unique genetic code that subtly or significantly shapes their psychological and behavioral landscape.
The complex relationship between genetics and psychology is observable through common biological components such...
The complex relationship between genetics and psychology is observable through common biological components such...
901
01:23Drugs Acting on Autonomic Ganglia: Stimulants
1.7K
Ganglionic stimulants activate NM nicotinic receptors in autonomic ganglia, falling into two categories: nicotine mimetics [e.g., lobeline, dimethylpiperazine, tetramethylammonium] and muscarinic receptor agonists [e.g., muscarine, methacholine]. The first category's action is rapid and blocked by nicotinic receptor antagonists, while the second category's action is delayed and blocked by atropine-like agents. Nicotine, an alkaloid, affects the heart rate by stimulating...
1.7K
01:29Drugs Affecting Neurotransmitter Synthesis
1.7K
Drugs affecting neurotransmitter synthesis can impact the adrenergic neuron and the synthesis of neurotransmitters. For example, α-methyltyrosine and carbidopa target specific enzymes involved in catecholamine synthesis. α-methyltyrosine inhibits the enzyme tyrosine hydroxylase, which converts tyrosine into dopamine. By blocking this enzyme, α-methyltyrosine reduces dopamine production and other catecholamines. Carbidopa, on the other hand, inhibits the enzyme dopa decarboxylase,...
1.7K
01:26Neurochemical Transmission: Sites of Drug Action
3.0K
Neurochemical transmission, the conduction of electrical impulses between neurons mediated by neurotransmitters, plays a vital role in various physiological processes. Autonomic drugs exert their effects by modulating neurotransmission within the autonomic nervous system. For instance, drugs such as hemicholinium block the precursor uptake necessary for synthesizing acetylcholine, an essential autonomic neurotransmitter. Following synthesis, neurotransmitters are stored in vesicles. Metyrosine...
3.0K
01:25Motivational Bias
151
Cognitive bias results from limitations in thinking and information processing, leading to systematic errors in judgment. Conversely, motivational bias stems from personal desires or emotions, causing distortions in perception to align with self-interest. Motivational bias influences how individuals perceive and attribute causes to events, often shaped by personal needs, goals, and self-esteem preservation. This bias can distort judgment, leading to inaccurate assessments of success, failure,...
151
01:15Drug Abuse and Addiction: Pharmacological Phenomena
830
Drug dependence, abuse, and addiction are complex phenomena that can precipitate various abnormal states. Physical dependence refers to a state of pharmacological adaptation to a drug. This adaptation often results in tolerance—a reduced response to the drug after repeated administrations. When the drug use is abruptly stopped, withdrawal symptoms occur due to the body's need to readjust from the pharmacologically induced imbalance. However, tolerance and withdrawal symptoms do not...
830