Related Experiment Video
Updated: Mar 19, 2026

A Conflict Model of Reward-seeking Behavior in Male Rats
Published on: February 20, 2019
Impulsivity and predictive control are associated with suboptimal action-selection and action-value learning in
Matthew S M Lim1, Gerhard Jocham2, Laurence T Hunt2
1Research Department of Clinical, Educational and Health Psychology, University College London, UK.
Abstract:
Heightened impulsivity and cognitive biases are risk factors for gambling problems. However, little is known about precisely how these factors increase the risks of gambling-related harm in vulnerable individuals. Here, we modelled the behaviour of eighty-seven community-recruited regular, but not clinically problematic, gamblers during a binary-choice reinforcement-learning game, to characterise the relationships between impulsivity, cognitive biases, and the capacity to make optimal action selections and learn about action-values. Impulsive gamblers showed diminished use of an optimal (Bayesian-derived) probability estimate when selecting between candidate actions, and showed slower learning rates and enhanced non-linear probability weighting while learning action values. Critically, gamblers who believed that it is possible to predict winning outcomes (as 'predictive control') failed to use the game's reinforcement history to guide their action selections. Extensive evidence attests to the ease with which gamblers can erroneously perceive structure in the reinforcement history of games when there is none. Our findings demonstrate that the generic and specific risk factors of impulsivity and cognitive biases can interfere with the capacity of some gamblers to utilise structure when it is available in the reinforcement history of games, potentially increasing their risks of sustaining gambling-related harms.
Related Concept Videos
Self-Regulation
Decision Making
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Instinctive Drift
Timing and Consequences on Behavior
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Self-Presentation: Self-Monitoring and Self-Handicapping

