Related Experiment Video
Updated: Mar 23, 2026
08:35
An Operant Intra-/Extra-dimensional Set-shift Task for Mice
Published on: January 22, 2016
12.9K
A model for discriminating reinforcers in time and space
Sarah Cowie1, Michael Davison1, Douglas Elliffe1
1The University of Auckland, New Zealand.
Behavioural Processes
|March 27, 2016
Summary
This study models choice over time by examining how animals discriminate between elapsed time and reinforcement schedules. A model redistributing reinforcer numbers better explained animal choices in timing tasks.
Area of Science:
- Behavioral psychology
- Animal cognition
- Learning theory
Background:
- Discrimination learning involves both response-reinforcer and stimulus-reinforcer relations.
- Elapsed time can serve as a discriminative stimulus for reinforcement availability.
Purpose of the Study:
- To extend a model of choice over time by incorporating discrimination of stimulus-reinforcer and response-reinforcer relations.
- To assess two methods of modeling errors in stimulus-reinforcer discrimination.
Main Methods:
- Applied an extended Davison and Nevin (1999) model to choice-based timing tasks.
- Compared two approaches for modeling stimulus-reinforcer discrimination errors: redistributing reinforcer numbers versus redistributing reinforcer ratios.
- Included a parameter for response-reinforcer discrimination error.
Main Results:
- The model version redistributing reinforcer numbers accounted for more data variance.
- This model explained shifts in the point of subjective equality with changing reinforcer rates.
- Adding response-reinforcer discrimination error improved model fit.
Conclusions:
- Timing behavior is choice under the control of elapsed time and differential reinforcement.
- Understanding differential reinforcement is crucial for understanding time control.
- The proposed model effectively accounts for temporal discrimination data.
Related Concept Videos
01:24Reinforcement Schedules
681
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
681
01:08Timing and Consequences on Behavior
632
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
632
01:23Primary and Secondary Reinforcers
1.5K
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
1.5K
01:24Generalization, Discrimination, and Extinction
1.8K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.8K
01:23Reinforcement
1.1K
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
1.1K
01:06Law of Effect
5.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
5.4K