Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Operant Conditioning01:21

Operant Conditioning

3.4K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
3.4K
Reinforcement01:23

Reinforcement

1.1K
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
1.1K
Generalization, Discrimination, and Extinction01:24

Generalization, Discrimination, and Extinction

1.9K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.9K
Reinforcement Schedules01:24

Reinforcement Schedules

692
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
692
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

694
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
694
Operant Conditioning Intervention01:24

Operant Conditioning Intervention

657
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
657

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Some remarks on the quantitative analysis of behavior.

The Behavior analyst·2012
Same author

Dimension in action: A commentary on Powell and Dickie.

The Behavior analyst·2012
Same author

The speciation of behavior analysis: the unnatural selection of foxes and hedgehogs.

The Behavior analyst·2012
Same author

Contextualistic mechanism or mechanistic contextualism?: The straw machine as tar baby.

The Behavior analyst·2012
Same author

Some reflections on Kantor's (1970) "An analysis of the experimental analysis of behavior (TEAB)".

The Behavior analyst·2012
Same author

Effects of prenatal maternal ethanol on male offspring progressive-ratio performance and response to amphetamine.

Neurotoxicology and teratology·1995
Same journal

The Genoeconomics of Impulsive Intertemporal Choice: A Critical Review.

Journal of the experimental analysis of behavior·2026
Same journal

Shaping the extinction burst: Increasing its probability and preventing its emergence across topographies.

Journal of the experimental analysis of behavior·2026
Same journal

Evaluating the combined effects of effort and probability on monetary discounting.

Journal of the experimental analysis of behavior·2026
Same journal

An improved translational approach to studying persistence-strengthening effects of differential reinforcement of alternative behavior.

Journal of the experimental analysis of behavior·2026
Same journal

Interactions between the effects of food and water motivating operations on concurrent food- and water-reinforced responding in mice.

Journal of the experimental analysis of behavior·2026
Same journal

Odor-visual and visual-visual matching to sample with dogs.

Journal of the experimental analysis of behavior·2026
See all related articles

Related Experiment Video

Updated: Apr 3, 2026

Errors as a Means of Reducing Impulsive Food Choice
07:07

Errors as a Means of Reducing Impulsive Food Choice

Published on: June 5, 2016

9.3K

Choice and reinforcement delay.

G D Gentry, M J Marr

    Journal of the Experimental Analysis of Behavior
    |January 1, 1980
    PubMed
    Summary
    This summary is machine-generated.

    Pigeon choice behavior is influenced by both relative and absolute delays to reinforcement. Findings suggest current models need refinement to accurately predict choices, especially with longer delays.

    More Related Videos

    Measuring Delay Discounting in Humans Using an Adjusting Amount Task
    07:47

    Measuring Delay Discounting in Humans Using an Adjusting Amount Task

    Published on: January 9, 2016

    16.1K
    Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
    09:12

    Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

    Published on: March 17, 2019

    10.4K

    Related Experiment Videos

    Last Updated: Apr 3, 2026

    Errors as a Means of Reducing Impulsive Food Choice
    07:07

    Errors as a Means of Reducing Impulsive Food Choice

    Published on: June 5, 2016

    9.3K
    Measuring Delay Discounting in Humans Using an Adjusting Amount Task
    07:47

    Measuring Delay Discounting in Humans Using an Adjusting Amount Task

    Published on: January 9, 2016

    16.1K
    Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
    09:12

    Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

    Published on: March 17, 2019

    10.4K

    Area of Science:

    • Behavioral science
    • Animal cognition
    • Operant conditioning

    Background:

    • Previous research suggests relative immediacy of reinforcers is key in choice behavior.
    • Studies on interresponse times show exceptions to this rule.
    • Understanding choice determinants is crucial for behavioral economics.

    Purpose of the Study:

    • To investigate pigeon choice behavior between two delays with varying absolute durations.
    • To determine if relative immediacy alone dictates choice or if absolute delays play a role.
    • To evaluate the applicability of existing models to observed choice patterns.

    Main Methods:

    • Pigeons were presented with choices between two delayed reinforcers.
    • One delay was consistently four times longer than the other.
    • Absolute durations of delays were systematically manipulated across experimental conditions.

    Main Results:

    • Choice behavior was not solely determined by the relative immediacy of reinforcement.
    • Absolute durations of delays significantly influenced the choice patterns.
    • The matching relation was less applicable than concurrent chained schedule models.

    Conclusions:

    • Both relative and absolute delay durations are critical factors in choice behavior.
    • Existing models, including concurrent chained schedules, require modification to account for observed data, particularly with longer delays.
    • Further research is needed to develop more comprehensive predictive models for choice under delayed reinforcement.