Related Experiment Video
Updated: Aug 7, 2026

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
Published on: March 17, 2019
Variation in Herrnstein's r(o) as a function of alternative reinforcement rate
Abstract:
In a test of Herrnstein's (1970, 1974) equation for simple schedules, 15 pigeons pecked a key that produced food delivered according to variable-interval schedules. One group of birds was water deprived, and food-reinforced key pecking occurred in the presence of free water. Two other groups were not water deprived; water was present for one and absent for the other. As predicted by Herrnstein, the parameter r(o) was significantly higher in the water-deprived group than in the two nondeprived groups. Contrary to Herrnstein's interpretation of r(o), the rate of drinking varied across schedules. Herrnstein's interpretation can be salvaged by considering r(o) to be an average. However, if r(o) is an average, the equation is not a good explanation of behavior because this average is not valid until all schedules have been sampled. In addition, low percentages of variance accounted for suggest that Herrnstein's equation may be of limited usefulness even as a descriptive model for these situations.
Related Concept Videos
Reinforcement Schedules
Once a behavior is learned,...
Timing and Consequences on Behavior
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Generalization, Discrimination, and Extinction
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Operant Conditioning
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Law of Effect
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Reinforcement
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:

