Related Experiment Video
Updated: May 29, 2026
08:24
The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
Published on: August 25, 2023
Deciding when to "cash in" when outcomes are continuously improving: an escalating interest task
Michael E Young1, Tara L Webb, Eric A Jacobs
1Southern Illinois University at Carbondale, IL 62901, USA. meyoung@siu.edu
Behavioural Processes
|August 30, 2011
Summary
This study used a video game to explore decision-making between immediate and delayed rewards. Participants adjusted their waiting time based on how outcomes improved over time, showing sensitivity to delay to reinforcement.
Area of Science:
- Behavioral Economics
- Psychology
- Video Game Research
Background:
- Decision-making involves choosing between smaller sooner and larger later outcomes.
- Understanding sensitivity to delay to reinforcement is crucial in behavioral studies.
Purpose of the Study:
- To investigate choice between smaller sooner and larger later outcomes using a novel video game paradigm.
- To assess participant sensitivity to the rate of outcome improvement over time.
Main Methods:
- A first-person shooter video game was adapted to simulate escalating reward potential.
- Participants made choices involving waiting for increased weapon damage (outcome).
- Two experiments manipulated the mathematical function relating waiting time to outcome improvement.
Main Results:
- Participants demonstrated sensitivity to the mathematical function defining waiting and outcome potential.
- Waiting time increased when it led to faster target elimination.
- Participants waited longer to increase outcome probability versus outcome magnitude for equivalent expected values.
Conclusions:
- The video game task effectively models sensitivity to delay to reinforcement.
- Participants adapt their choices based on how outcomes improve continuously.
- This paradigm is suitable for studying delay discounting across species.
Related Concept Videos
01:08Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
01:09Decision Making: P-value Method
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
01:25The Anchoring-and-Adjustment Heuristic
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the $2,000...
01:24Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
01:52Persuasion Strategies
Researchers have tested many persuasion strategies, including the foot-in-the door and the door-in-the-face techniques, in a variety of contexts. Ultimately, the principles are effective in selling products and changing people’s attitude, ideas, and behaviors (Cialdini & Goldstein, 2004).
01:14Decision Making: Traditional Method
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...