Related Experiment Video
Updated: Mar 7, 2026

Reinstatement of Drug-seeking in Mice Using the Conditioned Place Preference Paradigm
Published on: June 7, 2018
Reinforcer devaluation affect within-bout responses to a greater degree than bout-initiation responses on human
1Department of Psychology, Swansea University.
None:
Six experiments with human participants explored the effects of a reinforcer devaluation procedure on the microstructure of free-operant schedule performance, which is theoretically and empirically novel. The goal was to test whether different aspects of the microstructure of free-operant responding would be differentially affected by the manipulation to test the view that bout-initiation responses can be regarded as stimulus-driven habits both susceptible to devaluation, and within-bout responses as goal-directed actions that are susceptible to such effects. Humans responded to a fictitious investment game in which responses made investments in two countries with different currencies. These currencies had an exchange rate into Great British Pound (GBP), which could be manipulated to devalue the currency (reinforcer). In Experiments 1a and 2, random ratio schedules showed overall devaluation effects, which were limited to within-bout rates and more pronounced on longer ratios. In Experiments 1b and 3, random interval schedules showed limited devaluation effects, overall, except for with shorter intervals. This effect was seen on some schedules for within-bout responding. Experiments 4 and 5 manipulated the response-reinforcer feedback function (Experiment 4) and participants' ability to experience contingency variations by pretraining to be variable or static in response rates (Experiment 5). Only when there was a stronger response-reinforcer relationship (Experiment 4), which could be experienced due to variable responding (Experiment 5), did the devaluation effect occur, and these effects were limited to within-bout responses. These data suggest that an account of free-operant responding based on there being, at least, two classes of response-bout initiations that are stimulus-driven habits, and within-bout responses that are goal-directed actions-may explain many schedule effects. (PsycInfo Database Record (c) 2026 APA, all rights reserved).
Related Concept Videos
Timing and Consequences on Behavior
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Operant Conditioning
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Primary and Secondary Reinforcers
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Operant Conditioning Intervention
In operant conditioning, behaviors that are...
Law of Effect
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Generalization, Discrimination, and Extinction
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...

