Related Experiment Video
Updated: Apr 19, 2026
09:12
Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
Published on: March 17, 2019
10.6K
Inter-response-time reinforcement and relative reinforcer frequency control choice
Takayuki Tanno1, Alan Silberberg
1Department of Psychological Sciences, Kwansei Gakuin University, 1-1-155 Uegahara, Nishinomiya, Hyogo, 662-8501, Japan, tantantan01@gmail.com.
Learning & Behavior
|December 18, 2014
Summary
Rats
Area of Science:
- Behavioral psychology
- Animal behavior studies
Background:
- Operant conditioning principles
- Reinforcement schedules in animal learning
Purpose of the Study:
- Investigate the dual control mechanisms of choice behavior in rats
- Examine the interplay between inter-response-time reinforcement and reinforcer frequency
Main Methods:
- Utilized two-component multiple schedules and a variable-environment procedure with rats
- Manipulated variable-ratio (VR) and differential reinforcement of low rates (DRL) schedules alongside variable-interval (VI) schedules
- Measured local response rates and relative time allocations to different schedules
Main Results:
- Local response rates were sensitive to VR and tandem VR-DRL schedules compared to yoked VI schedules
- Relative time allocations covaried with relative reinforcer frequencies across conditions
- Local response rates showed bias towards unchanged VI schedules when paired with tandem VI-DRL
Conclusions:
- Choice behavior is controlled by two distinct processes: inter-response-time reinforcement influencing response rates and reinforcer frequency influencing time allocation
- Demonstrates a sophisticated model for understanding decision-making in animal behavior
- Highlights the importance of schedule properties in shaping complex operant behavior
Related Concept Videos
01:24Reinforcement Schedules
723
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
723
01:08Timing and Consequences on Behavior
802
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
802
01:23Primary and Secondary Reinforcers
1.7K
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
1.7K
01:21Operant Conditioning
3.5K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
3.5K
01:23Reinforcement
1.2K
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
1.2K
01:24Operant Conditioning Intervention
690
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
690