Related Experiment Video
Updated: Jun 3, 2026

07:07
Errors as a Means of Reducing Impulsive Food Choice
Published on: June 5, 2016
The effects of a local negative feedback function between choice and relative reinforcer rate
Michael Davison1, Douglas Elliffe, M Jackson Marr
1The University of Auckland, City Campus, Private Bag, Auckland, New Zealand. m.davison@auckland.ac.nz
Journal of the Experimental Analysis of Behavior
|April 1, 2011
Summary
This study on pigeon behavior found that a negative feedback function significantly reduced choice. Increasing the feedback slope decreased overall choice across sessions.
Area of Science:
- Behavioral psychology
- Animal behavior
- Operant conditioning
Background:
- Concurrent variable-interval schedules are fundamental to understanding choice behavior.
- Previous research often focuses on local reinforcement effects, neglecting molar properties.
- Molar feedback functions introduce a link between choice patterns and future reinforcement probabilities.
Purpose of the Study:
- To investigate the impact of molar feedback functions on choice behavior in pigeons.
- To examine how the slope of a negatively sloped feedback function influences choice.
- To differentiate between local and molar effects in concurrent schedule performance.
Main Methods:
- Four pigeons were trained on a two-key concurrent variable-interval schedule without changeover delay.
- Phase 1 involved varying relative reinforcers across five conditions.
- Phases 2 and 3 introduced linear, negatively sloped molar feedback functions with slopes of -1 and -3, respectively, altering reinforcement probability based on prior choice.
Main Results:
- Local choice behavior within interreinforcer intervals showed minimal effects from the feedback functions.
- Choice measured across extended sessions was significantly reduced as the negative slope of the feedback function increased.
- Increasing the negative slope from -1 to -3 led to a strong decrease in overall choice.
Conclusions:
- Molar feedback functions, particularly those with steeper negative slopes, exert a significant influence on overall choice behavior.
- The findings highlight the importance of considering molar properties in understanding choice under concurrent schedules.
- Behavioral economics principles can be applied to animal choice, demonstrating sensitivity to long-term reinforcement contingencies.
Related Concept Videos
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Effects of feedback
Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Positive and Negative Feedback Loops
Animal organs and organ systems constantly adjust to internal and external changes through a process called homeostasis ("steady state"). Examples of these changes include regulation of the level of glucose or calcium in the blood or internal responses to external temperatures. Homeostasis requires maintaining an internal dynamic equilibrium:

