Reinforcement of behavioral patterns: shaping a scallop
Journal of the Experimental Analysis of Behavior
|January 1, 1975
Summary
Pigeons learned temporal patterns of key pecking when reinforcement depended on behavior conforming to a specific pattern. This new schedule improved pattern approximation and reduced variability compared to traditional methods.
Area of Science:
- Behavioral science
- Animal behavior studies
- Operant conditioning research
Background:
- Traditional fixed-interval schedules often show variability in response patterns.
- Understanding how complex temporal patterns are learned is crucial in behavioral science.
- Pigeon key pecking is a standard model for studying operant conditioning.
Purpose of the Study:
- To investigate a novel reinforcement schedule for shaping temporal patterns in pigeon key pecking.
- To compare the effectiveness of this new schedule against a standard fixed-interval schedule.
- To explore the concept of reinforcing entire behavioral patterns as single operants.
Main Methods:
- Pigeons were trained on a schedule where food delivery was contingent on conforming to a specific temporal pattern of key pecking within a 5-second trial.
- This pattern approximated a constant rate of change in pecking frequency.
- Behavior was compared to that maintained by a classical fixed-interval 5-second schedule.
Main Results:
- The novel schedule produced a better approximation of the target temporal "scallop" pattern within trials.
- This schedule significantly reduced variability in behavior across different pigeons.
- Behavioral patterns, not just terminal responses, were effectively shaped by the reinforcement contingency.
Conclusions:
- Reinforcement delivered after a behavioral pattern can strengthen the entire pattern as a unit.
- The specific topography of responses immediately preceding reinforcement may be less critical than the overall pattern.
- Mean response rate can be a byproduct of strengthened patterns and may not always reflect fundamental controlling relationships.
Related Concept Videos
Role of Shaping in Operant Conditioning
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
Operant Conditioning Intervention
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...


