Related Experiment Video
Updated: May 15, 2026

A Procedure to Study Stress-Induced Relapse of Heroin Seeking after Punishment-Imposed Abstinence
Published on: March 23, 2022
Conditioned reinforcement in chain schedules when time to reinforcement is held constant
Matthew C Bell1, Ben A Williams
1Psychology Department, Santa Clara University, 500 El Camino Real, Santa Clara, CA 95053, USA. mbell@scu.edu
Abstract:
Two alternative approaches describe determinants of responding to a stimulus temporally distant from primary reinforcement. One emphasizes the temporal relation of each stimulus to the primary reinforcer, with relative proximity of the stimulus determining response rate. A contrasting view emphasizes immediate consequences of responding to the stimulus, the key factor being the conditioned reinforcement value of those immediate consequences. To contrast these approaches, 4 pigeons were exposed to a two-component multiple schedule with three-link chain schedules in each component. Only middle-link stimuli differed between chains. Baseline reinforcement probabilities were 0.50 for both chains; during discrimination phases it was 1.0 for one chain and 0.0 for the other. During discrimination phases pigeons responded more to the reinforcement-correlated middle link than to the extinction-correlated middle link, demonstrating that responding was affected by the probability change. Terminal link responding was also higher in the reinforced chain, even though the terminal link stimulus was identical in both chains. Of greatest interest is initial link responding, which was temporally most distant from reinforcement. Initial link responding, necessarily equal in the two chains, was significantly higher during the 1.0/0.0 discrimination phases, even though overall reinforcement probability remained constant. For 3 of 4 birds, in fact, initial-link response rates were higher than terminal-link response rates, an outcome that can be ascribed only to the potent conditioned reinforcement properties of the middle-link stimulus during the discrimination phases. Results are incompatible with any account of chain behavior based solely on relative time to reinforcement.
Related Concept Videos
Reinforcement Schedules
Once a behavior is learned,...
Timing and Consequences on Behavior
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Real-World Application of Classical Conditioning
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Principles of Classical Conditioning
During the...
Operant Conditioning
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Generalization, Discrimination, and Extinction
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...

