Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Cognitive Learning

Cognitive Learning

Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...

Law of Effect

Law of Effect

B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...

Purposive Learning

Purposive Learning

E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...

Behaviorism

Behaviorism

The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...

Incentive Theory: Pull Theory of Motivation

Incentive Theory: Pull Theory of Motivation

Incentive theory, or the "pull theory" of motivation, suggests that external rewards primarily drive behavior. Individuals are motivated to engage in activities when they anticipate a desirable outcome. This is why people often work hard for promotions or study intensively to achieve high grades. These incentives can be tangible, physical rewards such as money or promotions, or intangible, non-physical rewards like praise and social recognition.
The theory differentiates between...

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

LLMs are not ready for editorial work.

Nature human behaviour·2023

Same author

How biological attention mechanisms improve task performance in a large-scale visual system model.

eLife·2018

Same author

16-kDa prolactin down-regulates inducible nitric oxide synthase expression through inhibition of the signal transducer and activator of transcription 1/IFN regulatory factor-1 pathway.

Cancer research·2005

See all related articles

Search research articles

Related Experiment Video

Updated: Apr 18, 2026

Pavlovian Conditioned Approach Training in Rats

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

Modulation of feature attention by reward prediction error explains value learning behavior.

Mingze L Leukos¹, Albert Liang¹, Grace W Lindsay^1,2

¹Department of Psychology, New York University, New York, NY 10003, USA.

Biorxiv : the Preprint Server for Biology

|April 17, 2026

Summary

This summary is machine-generated.

This study reveals how the brain uses reward prediction errors (RPEs) to guide attention for adaptive learning. A computational model shows attention inverts focus after negative RPEs, enabling rapid adaptation in changing environments.

Keywords:

attention behavior reinforcement learning

More Related Videos

Studying Food Reward and Motivation in Humans

Studying Food Reward and Motivation in Humans

Published on: March 19, 2014

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

Related Experiment Videos

Last Updated: Apr 18, 2026

Pavlovian Conditioned Approach Training in Rats

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

Studying Food Reward and Motivation in Humans

Studying Food Reward and Motivation in Humans

Published on: March 19, 2014

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

Area of Science:

Computational neuroscience
Cognitive science
Reinforcement learning

Background:

Adaptive behavior relies on learning environmental feature values and directing attention to potential rewards.
Reward prediction errors (RPEs) are crucial for value learning and guiding attention, but the precise link remains unclear.

Purpose of the Study:

To investigate how value and RPE signals modulate attentional gain during learning using a reinforcement learning model.
To compare different RPE-attention transfer functions and attention mechanisms (single- vs. multi-focus).

Main Methods:

Developed a reinforcement learning model with a perceptual front-end.
Compared five candidate RPE-attention transfer functions with single- or multi-focus attention.
Collected behavioral data from macaques performing a color-value learning task with shifting reward contingencies.
Analyzed neural data from prefrontal cortex, frontal eye fields, and lateral intraparietal area.

Main Results:

Single-focus attention models better matched macaque errors than multi-focus models, suggesting a winner-take-all attentional focus.
A 'Switch' model, where attention inverts after negative RPEs, best explained exploration dynamics and decision confidence.
A significant percentage of neurons in key brain areas encoded RPEs.

Conclusions:

Capacity-constrained attention that inverts focus after negative RPEs provides the best explanation for value learning dynamics.
This mechanism explains why biological learners prioritize rapid adaptation over asymptotic precision in volatile environments.