Related Experiment Video
Updated: Apr 28, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
Probabilistic choice: A simple invariance
1Department of Psychology, Duke University, Durham, NC 27706, U.S.A.
Animal behavior in probabilistic choice tasks, like the two-armed bandit, follows a simple rule: rewards increase choice probability, nonrewards decrease it. This behavior aligns with satisficing, not other choice theories.
Area of Science:
- Behavioral economics
- Animal cognition
- Reinforcement learning
Background:
- Subjects repeatedly choose between probabilistic reward alternatives (two-armed bandit).
- Behavior is influenced by reward and nonreward outcomes.
- A simple stochastic choice rule involves probability changes based on outcomes (reward following).
Purpose of the Study:
- To investigate the underlying principles of animal choice behavior in probabilistic reward scenarios.
- To determine if animal behavior aligns with satisficing principles.
- To compare experimental findings with existing theories of free-operant choice.
Main Methods:
- Experimental manipulation of probabilistic reward schedules.
- Theoretical modeling of choice behavior.
- Comparison of observed behavior with predictions from Bush-Mosteller, molar maximization, momentary maximizing, and melioration (matching) theories.
Main Results:
- Animal subjects exhibit source independence: reward/nonreward effects on choice probability are independent of the specific response.
- Animal subjects exhibit effect-ratio invariance: reward and nonreward effects maintain a constant ratio under fixed conditions.
- These properties align with the definition of satisficing.
Conclusions:
- Animal choice behavior in probabilistic settings is best described by satisficing.
- Existing theories like Bush-Mosteller and melioration (matching) do not fully predict or are inconsistent with the observed behavior.
More Related Videos
13:04Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
Published on: September 19, 2012
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
Related Concept Videos
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Randomized Experiments
Simple randomization
Simple...
Law of Independent Assortment
Law of Independent Assortment
Probability in Statistics
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
Random Variables
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...