Related Experiment Video
Updated: Jul 1, 2025

07:05
Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
Published on: September 10, 2018
6.0K
How do animals weigh conflicting information about reward sources over time? Comparing dynamic averaging models
Jack Van Allsburg1, Timothy A Shahan2
1Department of Psychology, Utah State University, Logan, Utah, USA. jack.vanallsburg@usu.edu.
Animal Cognition
|March 1, 2024
Summary
Animals exhibit spontaneous recovery of choice, reverting to older reward memories after a break. However, current models do not fully explain this foraging behavior in rats.
Area of Science:
- Behavioral neuroscience
- Animal cognition
Background:
- Optimal foraging theory posits animals maximize food intake.
- Mechanisms for tracking behavioral alternatives and choice remain unclear.
- Spontaneous recovery of choice, where past reward distributions influence current behavior after a hiatus, is a key phenomenon.
Purpose of the Study:
- To investigate spontaneous recovery of choice in rats.
- To compare the predictive accuracy of different computational models for animal decision-making.
- To test how rats integrate past and recent reward information.
Main Methods:
- Three free-operant experiments using a serial reversal design in rats.
- Concurrent variable interval schedules were used to bait two responses (A and B).
- A delay period was introduced before testing choice preference without reward.
Main Results:
- Data strongly supported the occurrence of spontaneous recovery of choice.
- The observed form and extent of recovery were inconsistent with tested computational models.
- Rats showed a reversion to behavioral allocation based on more distant past reward distributions.
Conclusions:
- Spontaneous recovery of choice is a robust phenomenon in rats.
- Existing computational models, including exponentially weighted moving average and Temporal Weighting Rule, do not fully account for the observed recovery.
- Further research is needed to refine decision rules and valuation functions in foraging models.
Related Concept Videos
Decision Making: P-value Method
5.3K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.3K
Decision Making: Traditional Method
4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K
Timing and Consequences on Behavior
90
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
90
Instinctive Drift
218
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
218
Decision Making
109
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
109
Reason and Intuition
6.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.4K

