Related Experiment Video
Updated: Apr 16, 2026

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
11.7K
Conditioned reinforcement and information theory reconsidered.
Timothy A Shahan1, Paul Cunningham
1Utah State University.
Journal of the Experimental Analysis of Behavior
|March 14, 2015
Summary
Information theory offers a new perspective on conditioned reinforcement by focusing on uncertainty reduction about primary reinforcers. This approach successfully explains observing behavior and aligns with Delay Reduction Theory.
Area of Science:
- Behavioral Psychology
- Learning Theory
- Information Theory
Background:
- Conditioned reinforcers historically linked to information about primary reinforcers.
- Previous information theory applications failed to adequately explain observing behavior.
- Modern learning theories often overlook information-based explanations for conditioned reinforcement.
Purpose of the Study:
- To re-evaluate information theory's role in conditioned reinforcement using recent advances.
- To demonstrate how information theory can explain previously problematic 'observing behavior'.
- To integrate Pavlovian conditioning principles with information-theoretic approaches to reinforcement.
Main Methods:
- Applied information theory to Pavlovian conditioning, focusing on uncertainty reduction.
- Calculated information based on reductions in uncertainty about the time to primary reinforcement.
- Compared predictions with Delay Reduction Theory in observing-response and concurrent-chains procedures.
Main Results:
- The novel information-theoretic approach successfully remedies failures in explaining observing behavior.
- The framework yields predictions consistent with Delay Reduction Theory.
- Demonstrates a formal link between information conveyed by conditioned reinforcers and their reinforcing power.
Conclusions:
- Recent advances in information theory provide a viable framework for understanding conditioned reinforcement.
- The approach offers an analytical explanation for the success of Delay Reduction Theory.
- Suggests conditioned reinforcement is fundamentally rooted in Pavlovian conditioning processes.
Related Concept Videos
Real-World Application of Classical Conditioning
2.4K
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
2.4K
Principles of Classical Conditioning
3.7K
Classical conditioning, as described by Ivan Pavlov, is a foundational concept in associative learning, where a neutral stimulus becomes capable of eliciting a conditioned response through association with an unconditioned stimulus. The process of acquisition, where this learning occurs, and the subsequent phenomena of contiguity, contingency, generalization, discrimination, extinction, and spontaneous recovery are crucial for a comprehensive understanding of classical conditioning.
During the...
During the...
3.7K
Law of Effect
6.0K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
6.0K
Behaviorism
8.2K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
8.2K
Cognitive Learning
1.6K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.6K
Generalization, Discrimination, and Extinction
2.0K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
2.0K

