Related Experiment Video
Updated: Jun 18, 2026
09:43
The 5-Choice Serial Reaction Time Task: A Task of Attention and Impulse Control for Rodents
Published on: August 10, 2014
Reinforcement omission in concurrent fixed-interval and random-interval schedules.
Taku Ishii1, Takayuki Sakagami
1Centre for Integrated Research on the Mind, Keio University, 3-1-7 Mita-Toho Bldg. 7F, Mita, Minato-ku, Tokyo 108-8345, Japan. ishii@psy.flet.keio.ac.jp
Behavioural Processes
|February 6, 2007
Summary
Reinforcer omission in choice situations affects pigeon behavior. While overall responding decreased, local analysis revealed increased responding after omissions, challenging assumptions about relative rates reflecting choice value.
Area of Science:
- Behavioral psychology
- Animal behavior studies
Background:
- Understanding reinforcement schedules is crucial in behavioral psychology.
- Omission of expected rewards can alter response patterns.
Purpose of the Study:
- To investigate the overall and local effects of reinforcer omission in a choice setting.
- To examine how pigeons' key-pecking responses are affected by omitted food presentations.
Main Methods:
- Pigeons were trained on concurrent fixed-interval and random-interval schedules.
- A portion of fixed-interval reinforcers were omitted and replaced with timeout periods.
- Response rates were analyzed overall and within specific fixed-interval cycles.
Main Results:
- Overall responding to the fixed-interval schedule decreased during omission sessions.
- Local analysis showed higher relative rates of responding following omitted reinforcers compared to received reinforcers.
- Three out of four pigeons exhibited this local effect.
Conclusions:
- Relative rates of responding do not always accurately reflect the relative value of choice alternatives.
- The overall impact of reinforcer omission is more complex than simple local effects suggest.
Related Concept Videos
01:21Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
01:23Primary and Secondary Reinforcers
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
01:24Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
01:24Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
01:08Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
01:24Operant Conditioning Intervention
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...