Related Experiment Video
Updated: Sep 28, 2025

09:12
Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
Published on: March 17, 2019
9.6K
Impulsivity Relates to Multi-Trial Choice Strategy in Probabilistic Reversal Learning.
Amy R Zou1, Daniela E Muñoz Lopez1,2, Sheri L Johnson1
1Department of Psychology, University of California, Berkeley, Berkeley, CA, United States.
Frontiers in Psychiatry
|April 1, 2022
Summary
Impulsivity impacts learning by affecting how individuals respond to negative outcomes. This study reveals complex strategies, not simple deficits, in how impulsivity influences decision-making in reward-based tasks.
Area of Science:
- Neuroscience
- Cognitive Psychology
- Behavioral Economics
Background:
- Impulsivity is characterized by rash, poorly considered actions.
- Prior research links impulsivity to decision-making deficits, especially involving executive control and reward processing.
- Reinforcement learning (RL) integrates outcomes for decision-making and involves executive functions, making it relevant for studying impulsivity.
Purpose of the Study:
- To investigate the relationship between impulsivity and learning mechanisms within a reward-driven task.
- To examine how impulsivity affects performance in a task requiring executive functions and probabilistic feedback with reversals.
- To test the hypothesis that higher impulsivity correlates with poorer task performance, specifically more switching after negative outcomes.
Main Methods:
- A reward-driven learning task with probabilistic feedback and reversal learning was employed.
- Participant performance was analyzed, including trial-history dependent switching behaviors.
- Computational modeling was used to capture group-level learning behavior.
Main Results:
- The initial prediction of poorer performance with higher impulsivity was not supported.
- Advanced analyses revealed impulsivity specifically influenced switching behavior after consecutive unrewarded trials.
- Computational models accurately reflected group behavior but did not capture individual impulsivity effects.
Conclusions:
- Impulsivity's relationship with learning is complex, particularly concerning sensitivity to negative outcomes.
- The findings suggest that impulsivity may involve more intricate strategies in learning than currently modeled.
- Future research should explore these complex strategies in computational models of learning and impulsivity.
Related Concept Videos
Instinctive Drift
351
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
351
Reason and Intuition
7.0K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
7.0K
Timing and Consequences on Behavior
161
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
161
Decision Making: P-value Method
5.8K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.8K
Decision Making
265
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
265
Decision Making: Traditional Method
4.3K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.3K

