Related Experiment Video
Updated: Aug 7, 2026
06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
Bayesian theories of conditioning in a changing world
Aaron C Courville1, Nathaniel D Daw, David S Touretzky
1Département d'Informatique et de Recherche Opérationnelle, Université de Montréal, Montréal, QC H3C 3J7, Canada. courvila@iro.umontreal.ca
Trends in Cognitive Sciences
|June 24, 2006
Summary
Surprising events accelerate learning in animals by signaling uncertainty and the need for new information. This Bayesian perspective reinterprets classical conditioning, linking surprise to adaptive learning in changing environments.
Area of Science:
- Behavioral Science
- Cognitive Psychology
- Computational Neuroscience
Background:
- Classical conditioning is a fundamental learning process.
- Bayesian approaches offer a novel statistical framework for understanding behavior.
- Previous research indicates surprising events enhance learning.
Purpose of the Study:
- To explore the role of surprise in Pavlovian conditioning using a Bayesian framework.
- To interpret experimental findings on surprise from a statistical learning perspective.
- To connect surprise phenomena to the constraints of statistical learning theories.
Main Methods:
- Re-examination of classic issues in behavior through a Bayesian lens.
- Statistical modeling of conditioning processes.
- Interpretation of experimental data on surprise in learning.
Main Results:
- Surprise acts as a signal for environmental change and uncertainty.
- This uncertainty necessitates and accelerates new learning.
- Experimental results involving surprise align with a statistical inference model.
Conclusions:
- Bayesian statistical accounts provide principled interpretations of behavior.
- Surprise phenomena constrain and inform statistical theories of learning.
- This framework offers insights into both animal and human learning processes.
More Related Videos
Related Concept Videos
01:28Behaviorism
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
01:23Principles of Classical Conditioning
Classical conditioning, as described by Ivan Pavlov, is a foundational concept in associative learning, where a neutral stimulus becomes capable of eliciting a conditioned response through association with an unconditioned stimulus. The process of acquisition, where this learning occurs, and the subsequent phenomena of contiguity, contingency, generalization, discrimination, extinction, and spontaneous recovery are crucial for a comprehensive understanding of classical conditioning.
During the...
During the...
01:15Real-World Application of Classical Conditioning
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
01:06Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
01:17Classical Conditioning in Daily Life
Classical conditioning, a fundamental principle of associative learning, explains various phenomena observed in daily life, such as fear development, the placebo effect, taste aversion, and drug habituation. These applications demonstrate the profound impact of associative learning on human behavior and physiological responses.
John B. Watson and Rosalie Rayner famously demonstrated the development of fear through classical conditioning in their experiment with Little Albert. They paired the...
John B. Watson and Rosalie Rayner famously demonstrated the development of fear through classical conditioning in their experiment with Little Albert. They paired the...
01:18Classical Conditioning
Associative learning, a core principle in behavioral psychology, involves forming connections between events and facilitating learned responses. This concept is vividly illustrated by classical conditioning, a process extensively studied by the Russian physiologist Ivan Pavlov. Pavlov's pioneering research on dogs' digestive systems led to the discovery that behaviors can be learned through association, laying the groundwork for classical conditioning.
Ivan Pavlov observed that dogs salivated...
Ivan Pavlov observed that dogs salivated...