Related Experiment Video
Updated: Dec 29, 2025
09:12
Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
Published on: March 17, 2019
9.9K
Being there on time: Reinforcer effects on timing and locating
Sarah Cowie1, Michael Davison1
1The University of Auckland.
Journal of the Experimental Analysis of Behavior
|January 30, 2020
Summary
Reinforcers do not directly alter timing control. Instead, changes in choice behavior result from the combined influence of elapsed time and reinforcers, impacting how animals perceive environmental cues.
Area of Science:
- Behavioral science
- Animal behavior
- Psychology
Background:
- Timing research often assumes reinforcers directly modify time discrimination.
- The precise role of reinforcers in timing behavior requires further investigation.
Purpose of the Study:
- To investigate whether changes in choice behavior during timing tasks are due to joint control by time and reinforcers.
- To differentiate between direct modification of time control and joint control by reinforcers.
Main Methods:
- Pigeons were trained on a concurrent-choice task with location-based reinforcer probabilities that reversed over time.
- The percentage of reinforcers presented before the probability reversal was manipulated (5% to 95%).
Main Results:
- Manipulating reinforcer percentages affected control by location, but not by time.
- Choice behavior was accurately modeled by considering generalization across time and location of reinforcers.
Conclusions:
- Reinforcers do not solely modify time control but exert joint control with elapsed time.
- Reinforcers function similarly to other environmental events in controlling behavior, suggesting a broader role in stimulus control.
Related Concept Videos
01:08Timing and Consequences on Behavior
298
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
298
01:24Reinforcement Schedules
393
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
393
01:23Primary and Secondary Reinforcers
762
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
762
01:21Operant Conditioning
2.7K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
2.7K
01:06Law of Effect
2.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
2.3K
01:23Reinforcement
742
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
742