Related Experiment Video
Updated: Aug 7, 2026

06:11
A Conflict Model of Reward-seeking Behavior in Male Rats
Published on: February 20, 2019
Human self-control and the density of reinforcement
Journal of the Experimental Analysis of Behavior
|March 1, 1992
Summary
Human choice behavior in a button-pressing task depends on reinforcement density. Self-control was observed unless impulsive choices offered higher reinforcement density, demonstrating the impact of reinforcement schedules on decision-making.
Area of Science:
- Behavioral psychology
- Decision-making research
- Operant conditioning principles
Background:
- Understanding choice behavior is crucial in behavioral psychology.
- Reinforcement schedules significantly influence decision-making processes.
- Previous research highlights the role of reinforcement magnitude and delay in choice tasks.
Purpose of the Study:
- To investigate choice responding in adult humans under varying reinforcement conditions.
- To examine the influence of reinforcement amount, delay, and density on decision-making.
- To determine the predictive power of relative reinforcement densities on choice behavior.
Main Methods:
- A discrete-trial button-pressing task was employed with adult human participants.
- Reinforcement was delivered as points exchangeable for money.
- Conditions manipulated reinforcement amount, delay (prereinforcer and postreinforcer), and overall density.
Main Results:
- Choice responding was consistently predicted by the relative reinforcement densities of the alternatives.
- Self-control choices were prevalent, except when impulsive options yielded higher reinforcement density.
- Postreinforcer delays were manipulated to equate trial durations across conditions.
Conclusions:
- Choice behavior is a direct function of relative reinforcement densities when using conditioned reinforcers like points.
- Reinforcement immediacy can influence preference when densities are equal and reinforcers are intrinsic.
- Findings support the quantitative analysis of behavior in decision-making paradigms.
Related Concept Videos
Self-Regulation
Self-regulation, also known as self-control, encompasses a range of cognitive and behavioral processes that allow individuals to adjust their internal states and outward actions to align with socially acceptable norms and long-term goals. It plays a fundamental role in adaptive functioning, from resisting impulsive behaviors to persisting through challenging tasks. While its benefits are widely recognized, self-regulation is not limitless. Muraven and Baumeister's theory posits that...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
Self-Discrepancy Theory
One influential perspective on what motivates people's behavior is detailed in Tory Higgin's self-discrepancy theory (Higgins, 1987). He proposed that people hold disagreeing internal representations of themselves that lead to different emotional states.

