Related Experiment Video
Updated: Jul 9, 2026
07:05
Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
Published on: September 10, 2018
Discrete-trial vs. continuous free-operant procedures in assessing whether reinforcement context affects
Margaret A McDevitt1, Matthew C Bell
1Psychology Department, McDaniel College, 2 College Hill, Westminster, MD 21157, United States. mmcdevit@mcdaniel.edu
Behavioural Processes
|December 7, 2007
Summary
Pigeons showed a preference for higher reinforcement probabilities. However, continuous stimulus presentation during training led to a preference for a moderate schedule previously paired with leaner conditions, influencing choice behavior.
Area of Science:
- Behavioral psychology
- Animal cognition
- Reinforcement learning
Background:
- Concurrent reinforcement schedules are fundamental in understanding choice behavior.
- Pigeons (Columba livia) are widely used models for studying associative learning and decision-making.
- Understanding how training procedures influence preference is crucial for behavioral analysis.
Purpose of the Study:
- To investigate how different training procedures under concurrent reinforcement schedules affect pigeons' choice preferences.
- To examine the influence of stimulus duration and intertrial interval (ITI) presentation on preference.
- To determine if absolute reinforcement magnitude or relative context influences choice behavior.
Main Methods:
- Pigeons were trained on two alternating concurrent reinforcement schedules with varying probabilities (.05, .10, .20).
- Two training conditions were used: discrete-trial (stimuli on for 5s or until response) and continuous-stimulus (stimuli remained on).
- Probe tests were conducted after training to assess preference between alternatives.
Main Results:
- Overall, the .20 reinforcement probability was preferred over the .05 probability in both training conditions.
- Following discrete-trial training, no significant preference was found between the two .10 alternatives.
- After continuous-stimulus training, pigeons preferred the .10 alternative previously associated with the leaner schedule (.05).
Conclusions:
- Probe preference is influenced by both absolute reinforcement probabilities and the relative context established during training.
- Changeover behavior and stimulus presentation during ITIs can modulate choice preferences in concurrent schedules.
- The findings highlight the dynamic interplay between reinforcement history and stimulus conditions in shaping decision-making.
Related Concept Videos
01:24Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
01:21Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
01:24Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
01:24Operant Conditioning Intervention
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
01:08Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
01:23Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example: