Related Experiment Video
Updated: May 9, 2026

09:12
Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
Published on: March 17, 2019
Computational model of selection by consequences: patterns of preference change on concurrent schedules
Saule Kulubekova1, J J McDowell
1Emory University.
Journal of the Experimental Analysis of Behavior
|July 31, 2013
Summary
This study validates a computational model of adaptive behavior using genetic algorithms. The model accurately simulates organismal responses, supporting selectionist theories of behavior.
Area of Science:
- Behavioral science
- Computational modeling
- Evolutionary psychology
Background:
- The selection by consequences principle explains adaptive behavior.
- Computational models offer a method to test behavioral theories.
Purpose of the Study:
- To assess a computational model of selection by consequences.
- To investigate preference change phenomena in dynamic reinforcement environments.
Main Methods:
- Utilized a virtual organism based on a genetic algorithm.
- Tested the model with single alternative and concurrent schedules.
- Analyzed molar and molecular effects of behavioral adjustment.
Main Results:
- The computational model generated behavior quantitatively equivalent to live organisms.
- Molar and molecular effects of behavioral adjustment were consistent with observed phenomena.
- The model exhibited preference change phenomena in rapidly changing reinforcement rate ratios.
Conclusions:
- The computational model provides a robust account of adaptive behavior.
- Results strongly support the selectionist account of behavior.
- The model serves as a valuable tool for studying behavioral adaptation.
Related Concept Videos
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
Types of Selection
Natural selection influences the frequencies of particular alleles and phenotypes within populations in several different ways. Primarily, natural selection can be directional, stabilizing, or disruptive. Directional selection favors one extreme trait and shifts the population towards that phenotype while selecting against individuals displaying alternate traits. Stabilizing selection favors an intermediate trait with a narrow range of variation. Deviation from the optimal phenotype towards an...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Frequency-dependent Selection
When the fitness of a trait is influenced by how common it is (i.e., its frequency) relative to different traits within a population, this is referred to as frequency-dependent selection. Frequency-dependent selection may occur between species or within a single species. This type of selection can either be positive—with more common phenotypes having higher fitness—or negative, with rarer phenotypes conferring increased fitness.
Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Behavioral Genetics and Its Designs
Behavior genetics explores how genetic inheritance influences human behavior. It focuses on how genes, passed from parents to offspring, contribute to the development of behavioral traits and tendencies. This branch of genetics seeks to understand the complex interplay between inherited genetic factors and environmental influences in shaping our behaviors.
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...

