Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reason and Intuition01:37

Reason and Intuition

6.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.4K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

50
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
50
Decision Making01:20

Decision Making

106
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
106
Cognitive Learning01:21

Cognitive Learning

237
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
237
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

88
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
88

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same authorSame journal

Anhedonic Traits Do Not Impair Performance in a 3-Arm Bandit Task.

Computational psychiatry (Cambridge, Mass.)·2026
Same author

The effect of sertraline on networks of mood and anxiety symptoms: secondary analysis of the PANDA randomized controlled trial.

Nature. Mental health·2025
Same author

A computational approach to understanding effort-based decision-making in depression.

Psychological medicine·2025
Same author

Combined transcranial direct current stimulation and cognitive remediation therapy modestly slows cognitive decline in older adults with remitted depression and mild cognitive impairment.

Evidence-based nursing·2025
Same author

A computational approach to understanding effort-based decision-making in depression.

bioRxiv : the preprint server for biology·2024
Same author

Dissociable effects of dopaminergic medications on depression symptom dimensions in Parkinson disease.

Nature. Mental health·2024

Related Experiment Video

Updated: Jun 25, 2025

A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments
09:43

A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

Published on: April 15, 2014

10.6K

Reliability of Decision-Making and Reinforcement Learning Computational Parameters.

Anahit Mkrtchian1,2, Vincent Valton1, Jonathan P Roiser1

  • 1Neuroscience and Mental Health Group, Institute of Cognitive Neuroscience, University College London, London, United Kingdom.

Computational Psychiatry (Cambridge, Mass.)
|May 22, 2024
PubMed
Summary

Computational models of learning and decision-making show reliable individual measures. These findings support their use in precision psychiatry for understanding and treating psychiatric disorders.

Keywords:
Computational psychiatryDecision-makingGamblingProspect theoryReinforcement learningReliability

More Related Videos

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

6.0K
Operant Procedures for Assessing Behavioral Flexibility in Rats
08:30

Operant Procedures for Assessing Behavioral Flexibility in Rats

Published on: February 15, 2015

20.8K

Related Experiment Videos

Last Updated: Jun 25, 2025

A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments
09:43

A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

Published on: April 15, 2014

10.6K
Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

6.0K
Operant Procedures for Assessing Behavioral Flexibility in Rats
08:30

Operant Procedures for Assessing Behavioral Flexibility in Rats

Published on: February 15, 2015

20.8K

Area of Science:

  • Cognitive Neuroscience
  • Computational Psychiatry

Background:

  • Computational models offer mechanistic insights into cognition, crucial for psychiatric disorder research.
  • Reliable computational measures are essential for successful translational psychiatric research.

Purpose of the Study:

  • To assess the reliability of reinforcement learning and economic models in capturing individual characteristics.
  • To evaluate the translational potential of computational parameters for precision psychiatry.

Main Methods:

  • Fifty healthy individuals completed a restless four-armed bandit and a calibrated gambling task twice, with a two-week interval.
  • Reinforcement learning and prospect theory models were derived from task performance data.
  • Reliability of model parameters (learning rates, sensitivity, risk/loss aversion) was assessed.

Main Results:

  • Reinforcement learning parameters showed good to fair reliability.
  • Prospect theory parameters (risk and loss aversion) exhibited good to excellent reliability.
  • Both models predicted future individual behavior, with personalized parameters yielding better predictions.

Conclusions:

  • Reinforcement learning and prospect theory parameters derived from these tasks are reliably measurable.
  • These reliable computational parameters can assess learning and decision-making mechanisms.
  • Findings support the translational potential of computational parameters for precision psychiatry.