Related Experiment Video
Updated: May 30, 2025

06:11
A Conflict Model of Reward-seeking Behavior in Male Rats
Published on: February 20, 2019
7.3K
Punishment and dynamic choice: Assessment of the direct-suppression model
Rafaela M Fontes1, Timothy A Shahan1
1Utah State University, Logan, UT, USA.
Journal of the Experimental Analysis of Behavior
|January 31, 2025
Summary
Punishment rate significantly influences behavior, shifting choices towards less punished options. Findings challenge existing models and reveal punishment
Area of Science:
- Behavioral Psychology
- Animal Behavior Studies
- Operant Conditioning
Background:
- Understanding how punishment affects decision-making is crucial for behavioral modification.
- Existing models, like the direct-suppression model, offer predictions on punishment's impact on response allocation.
Purpose of the Study:
- To investigate the effects of varying punishment rates on response allocation in a choice procedure.
- To test predictions derived from a modified direct-suppression model.
- To analyze how punishment interacts with reinforcement schedules.
Main Methods:
- Utilized a choice procedure with rapidly changing relative reinforcement rates within sessions.
- Employed two experiments superimposing equal and unequal punishment rates on reinforcement schedules.
- Applied the generalized matching law to analyze response allocation data.
Main Results:
- Punishment increased preference for richer reinforcement schedules, irrespective of absolute punishment rates.
- Response allocation shifted away from schedules with higher punishment rates, indicating a bias against frequent punishment.
- The direct-suppression model's predictions were challenged by the experimental outcomes.
Conclusions:
- Punishment rate, not just its presence, critically modulates response allocation.
- Behavioral biases can emerge due to relative punishment frequencies, challenging simpler suppression models.
- The generalized matching law provides a framework for understanding how punishment affects sensitivity and bias in choice behavior.
Related Concept Videos
Punishment
144
Negative reinforcement and punishment are often confused but serve distinct functions in behavior modification. Reinforcement, whether positive or negative, increases the likelihood of a desired behavior, while punishment decreases it.
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
144
Timing and Consequences on Behavior
77
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
77
Operant Conditioning
1.5K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.5K
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K
The Behavioral Perspective on Personality
292
Behaviorists view personality as primarily shaped by environmental reinforcements and consequences. According to this perspective, behavior is influenced by external stimuli, and individuals adjust their actions based on rewards and punishments. Over time, learning histories — accumulated patterns of reinforcement — play a significant role in shaping personality. Behaviors that lead to positive outcomes are reinforced, while those resulting in negative outcomes are diminished.
292
Behavior Modification
124
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
A real-world application of operant conditioning principles is applied...
124

