Related Experiment Video
Updated: Mar 19, 2026

06:11
A Conflict Model of Reward-seeking Behavior in Male Rats
Published on: February 20, 2019
8.0K
Impulsivity and predictive control are associated with suboptimal action-selection and action-value learning in
Matthew S M Lim1, Gerhard Jocham2, Laurence T Hunt2
1Research Department of Clinical, Educational and Health Psychology, University College London, UK.
Summary
Impulsive gamblers struggle with decision-making and learning, while those believing in predictive control ignore game history. These cognitive factors increase gambling harm risks.
Area of Science:
- Cognitive psychology
- Behavioral economics
- Neuroscience of addiction
Background:
- Impulsivity and cognitive biases are known risk factors for gambling problems.
- The precise mechanisms linking these factors to gambling-related harm remain unclear, especially in vulnerable individuals.
Purpose of the Study:
- To investigate how impulsivity and cognitive biases affect decision-making and learning in regular gamblers.
- To characterize the relationship between these traits and the ability to make optimal choices and learn action values in a reinforcement-learning task.
Main Methods:
- Eighty-seven community-recruited regular gamblers participated in a binary-choice reinforcement-learning game.
- Behavioral data were analyzed to assess action selection, learning rates, and probability weighting.
- The study modeled relationships between impulsivity, cognitive biases, and learning parameters.
Main Results:
- Impulsive gamblers demonstrated reduced use of optimal probability estimates for action selection.
- Slower learning rates and increased non-linear probability weighting were observed in impulsive gamblers.
- Gamblers with a belief in 'predictive control' did not utilize reinforcement history for decision-making.
Conclusions:
- Impulsivity and cognitive biases impair the ability to utilize available structure in game reinforcement history.
- These cognitive deficits can elevate the risk of sustaining gambling-related harms.
- Understanding these mechanisms is crucial for developing targeted interventions for at-risk gamblers.
Related Concept Videos
Self-Regulation
308
Self-regulation, also known as self-control, encompasses a range of cognitive and behavioral processes that allow individuals to adjust their internal states and outward actions to align with socially acceptable norms and long-term goals. It plays a fundamental role in adaptive functioning, from resisting impulsive behaviors to persisting through challenging tasks. While its benefits are widely recognized, self-regulation is not limitless. Muraven and Baumeister's theory posits that...
308
Decision Making
1.2K
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
1.2K
Instinctive Drift
1.1K
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
1.1K
Timing and Consequences on Behavior
598
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
598
Decision Making: P-value Method
7.1K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
7.1K
Self-Presentation: Self-Monitoring and Self-Handicapping
45.1K
People can go to great lengths to protect their self-image and present themselves in ways that they want others to see them. Sociologist Erving Goffman presented the idea that a person is like an actor on a stage. Calling his theory dramaturgy, Goffman believed that we use “impression management” to present ourselves to others as we hope to be perceived. Each situation is a new scene, and individuals perform different roles depending on who is present (Goffman, 1959). Think about...
45.1K

