Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Principles of Classical Conditioning01:23

Principles of Classical Conditioning

Classical conditioning, as described by Ivan Pavlov, is a foundational concept in associative learning, where a neutral stimulus becomes capable of eliciting a conditioned response through association with an unconditioned stimulus. The process of acquisition, where this learning occurs, and the subsequent phenomena of contiguity, contingency, generalization, discrimination, extinction, and spontaneous recovery are crucial for a comprehensive understanding of classical conditioning.
During the...
Real-World Application of Classical Conditioning01:15

Real-World Application of Classical Conditioning

Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Classical Conditioning01:18

Classical Conditioning

Associative learning, a core principle in behavioral psychology, involves forming connections between events and facilitating learned responses. This concept is vividly illustrated by classical conditioning, a process extensively studied by the Russian physiologist Ivan Pavlov. Pavlov's pioneering research on dogs' digestive systems led to the discovery that behaviors can be learned through association, laying the groundwork for classical conditioning.
Ivan Pavlov observed that dogs salivated...
Classical Conditioning in Daily Life01:17

Classical Conditioning in Daily Life

Classical conditioning, a fundamental principle of associative learning, explains various phenomena observed in daily life, such as fear development, the placebo effect, taste aversion, and drug habituation. These applications demonstrate the profound impact of associative learning on human behavior and physiological responses.
John B. Watson and Rosalie Rayner famously demonstrated the development of fear through classical conditioning in their experiment with Little Albert. They paired the...
Associative Learning01:27

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Behaviorism01:28

Behaviorism

The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Investigating the replicability of the social and behavioural sciences.

Nature·2026
Same author

The role of future planning, patience, and risk tolerance for prospective reciprocity in human adults.

Scientific reports·2026
Same author

Effects of Initial Experiences on Risky Choice.

Quarterly journal of experimental psychology (2006)·2026
Same author

The use of AI in psychology: A historical perspective.

British journal of psychology (London, England : 1953)·2026
Same author

Greater impulsivity is associated with a reduced propensity to cash out of bets.

Addictive behaviors reports·2025
Same author

Associative Learning in a Conspiratorial Frame.

Quarterly journal of experimental psychology (2006)·2025
Same journal

Correction: Quantifying nonmnemonic strategies in two-alternative forced-choice delayed matching and nonmatching-to-position tasks in mice (Mus musculus) using automated video tracking technologies.

Learning & behavior·2026
Same journal

Unconditional stimulus deflation is stimulus specific.

Learning & behavior·2026
Same journal

What is possible and what is worth: Higher levers afford more work and enhance the value of leisure.

Learning & behavior·2026
Same journal

Behavioral impact of adolescent social isolation stress: A multidimensional assessment in male NMRI mice.

Learning & behavior·2026
Same journal

Behavioral characteristics of rapid visual categorization learning in domestic chicks.

Learning & behavior·2026
Same journal

Operant conditioning through positive reinforcement in the ghost crab (Ocypode quadrata).

Learning & behavior·2026
See all related articles

Related Experiment Video

Updated: May 19, 2026

Visual Classical Conditioning in Wood Ants
05:46

Visual Classical Conditioning in Wood Ants

Published on: October 5, 2018

Evaluating the TD model of classical conditioning.

Elliot A Ludvig1, Richard S Sutton, E James Kehoe

  • 1Princeton Neuroscience Institute and Department of Mechanical & Aerospace Engineering, Princeton University, 3-N-12 Green Hall, Princeton, NJ 08542, USA. eludvig@princeton.edu

Learning & Behavior
|August 29, 2012
PubMed
Summary
This summary is machine-generated.

The temporal-difference (TD) algorithm models animal learning in classical conditioning by predicting events. This study explores how different representations of conditioned stimuli (CSs) impact TD model performance in various conditioning tasks.

More Related Videos

Classical Short-Delay Eyeblink Conditioning in One-Year-Old Children
07:36

Classical Short-Delay Eyeblink Conditioning in One-Year-Old Children

Published on: September 1, 2018

Whisker-signaled Eyeblink Classical Conditioning in Head-fixed Mice
10:14

Whisker-signaled Eyeblink Classical Conditioning in Head-fixed Mice

Published on: March 30, 2016

Related Experiment Videos

Last Updated: May 19, 2026

Visual Classical Conditioning in Wood Ants
05:46

Visual Classical Conditioning in Wood Ants

Published on: October 5, 2018

Classical Short-Delay Eyeblink Conditioning in One-Year-Old Children
07:36

Classical Short-Delay Eyeblink Conditioning in One-Year-Old Children

Published on: September 1, 2018

Whisker-signaled Eyeblink Classical Conditioning in Head-fixed Mice
10:14

Whisker-signaled Eyeblink Classical Conditioning in Head-fixed Mice

Published on: March 30, 2016

Area of Science:

  • Computational Neuroscience
  • Behavioral Neuroscience
  • Machine Learning

Background:

  • Reinforcement learning's temporal-difference (TD) algorithm offers a method for incremental learning of event predictions.
  • In classical conditioning, TD models propose that animals learn real-time predictions of unconditioned stimuli (US) based on conditioned stimuli (CSs).
  • Learning in TD models is driven by prediction errors, with continuous learning occurring moment-to-moment, unlike trial-based models.

Purpose of the Study:

  • To evaluate the performance of the TD model in classical conditioning tasks.
  • To investigate the influence of different conditioned stimulus (CS) representations on TD model performance.
  • To explore an unexplored range of classical conditioning tasks using the TD model.

Main Methods:

  • The study applied the temporal-difference (TD) algorithm to classical conditioning paradigms.
  • Three distinct conditioned stimulus (CS) representations, varying in temporal generalization, were considered.
  • The performance of the TD model was evaluated across a range of classical conditioning tasks with these representations.

Main Results:

  • The choice of conditioned stimulus (CS) representation significantly influences the performance of the temporal-difference (TD) model in classical conditioning.
  • Different temporal generalization properties of CS representations lead to varied outcomes in TD model predictions.
  • The TD model's effectiveness is shown to be dependent on the specific characteristics of the stimulus representations used.

Conclusions:

  • The representation of conditioned stimuli (CSs) is a critical factor affecting the accuracy and learning dynamics of temporal-difference (TD) models in classical conditioning.
  • Understanding the interplay between CS representation and TD learning is essential for accurately modeling animal behavior.
  • Further research into various stimulus representations can refine TD models for better prediction of classical conditioning phenomena.