Related Experiment Video
Updated: Aug 7, 2026

08:35
An Operant Intra-/Extra-dimensional Set-shift Task for Mice
Published on: January 22, 2016
Decision rules and signal detectability in a reinforcement-density discrimination
Journal of the Experimental Analysis of Behavior
|July 1, 1979
Summary
Pigeons learned to discriminate between rich and lean reinforcement schedules. Choice behavior reflected relative expected payoff, not just the number or timing of reinforcers.
Area of Science:
- Behavioral Psychology
- Animal Cognition
- Operant Conditioning
Background:
- Investigates how animals discriminate between different probabilistic reinforcement schedules.
- Examines the role of stimulus properties in choice behavior.
Purpose of the Study:
- To determine if pigeons can discriminate between richer and leaner reinforcement schedules.
- To analyze how stimulus characteristics influence choice probability in a discrimination task.
- To assess whether choice behavior maximizes immediate payoff or considers overall expected value.
Main Methods:
- Pigeons were presented with two overlapping probabilistic reinforcement schedules (richer: 0.75, leaner: 0.25).
- A choice period followed each schedule, with left-key pecks reinforced for the richer schedule and right-key pecks for the leaner.
- Signal detection theory was used to analyze discriminability (d') of the schedule stimuli.
Main Results:
- Pigeons demonstrated high detectability (d') of the schedule stimuli.
- Left-key peck probability increased with more reinforcers, earlier reinforcers, and larger reward magnitudes.
- Choice probabilities matched relative expected payoff, even when substimuli had identical numbers of reinforcers but different temporal patterns.
Conclusions:
- Pigeons can effectively discriminate between complex probabilistic reinforcement schedules.
- Choice behavior is influenced by multiple stimulus factors, including reinforcer frequency, timing, and magnitude.
- Pigeons' choices align with maximizing relative expected payoff, indicating sophisticated evaluation of reinforcement contingencies.
Related Concept Videos
Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Classification of Signals
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Difference from Background: Limit of Detection
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
Sign Test for Matched Pairs
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in value between...
To conduct the sign test, we first calculate the differences in value between...

