Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Decision Making01:20

Decision Making

1.2K
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
1.2K
Cognitive Learning01:21

Cognitive Learning

1.5K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.5K
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

577
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
577
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

5.7K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
5.7K
Purposive Learning01:22

Purposive Learning

562
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
562
Observational Learning01:12

Observational Learning

1.2K
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
1.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Model-based and model-free valuation signals in the human brain vary markedly in relation to individual differences in behavioral control.

Cell reports·2026
Same author

Individual Brain Charting: fifth release of high-resolution fMRI data for cognitive mapping.

Scientific data·2026
Same author

The representation and valuation of subgoals in the human brain during model-based hierarchical behavior.

Neuron·2026
Same author

Computational and neural mechanisms underlying the influence of action affordances on value learning.

Nature communications·2026
Same author

Distributed activity in the human posterior putamen distinguishes goal-directed from habitual control.

bioRxiv : the preprint server for biology·2025
Same author

Is the Whole the Sum of its Parts? Neural Computation of Consumer Bundle Valuation in Humans.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2025
Same journal

Implicit Bias: Evolution of a Powerful Idea.

Annual review of psychology·2026
Same journal

Introduction.

Annual review of psychology·2026
Same journal

Social Robotics Is Not (Just) About Machines, It Is About People: Psychology's Role in Developing Social Machines.

Annual review of psychology·2025
Same journal

Intensive Longitudinal Methods: Toward a Psychological Science of Daily Life.

Annual review of psychology·2025
Same journal

Human Rationality.

Annual review of psychology·2025
Same journal

Space to Act, Think, and Create.

Annual review of psychology·2025
See all related articles

Related Experiment Video

Updated: Mar 14, 2026

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

6.5K

Learning, Reward, and Decision Making.

John P O'Doherty1, Jeffrey Cockburn1, Wolfgang M Pauli1

  • 1Division of Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125;

Annual Review of Psychology
|October 1, 2016
PubMed
Summary
This summary is machine-generated.

This review explores distinct behavioral control systems, including goal-directed (model-based) and habitual (model-free) strategies in conditioning. Neuroscience evidence supports separate neural substrates and interactions influencing adaptive or maladaptive outcomes.

Keywords:
Pavloviancognitive mapinstrumentalmodel basedmodel freeoutcome valuation

More Related Videos

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
09:13

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

14.9K
An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents
07:42

An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents

Published on: August 2, 2018

14.5K

Related Experiment Videos

Last Updated: Mar 14, 2026

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

6.5K
A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
09:13

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

14.9K
An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents
07:42

An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents

Published on: August 2, 2018

14.5K

Area of Science:

  • Neuroscience
  • Cognitive Science
  • Behavioral Economics

Background:

  • Behavioral control involves multiple strategies, including goal-directed (model-based) and habitual (model-free) systems.
  • These systems operate in both instrumental and Pavlovian conditioning domains.
  • Understanding these systems is crucial for explaining reward-related behaviors.

Purpose of the Study:

  • To review evidence for distinct behavioral control systems.
  • To examine the neuroscientific basis of these systems.
  • To explore their interactions and implications for behavior.

Main Methods:

  • Literature review of neuroscience and behavioral studies.
  • Analysis of findings on instrumental and Pavlovian conditioning.
  • Evaluation of evidence for distinct neuronal substrates.

Main Results:

  • Support for at least two primary behavioral control systems: model-based and model-free.
  • Evidence for distinct neural substrates underlying these systems.
  • Identification of interactions leading to adaptive and maladaptive behaviors.
  • Emerging evidence for a social inference system and arbitration mechanisms.

Conclusions:

  • Multiple, interacting systems govern reward-related behavior.
  • Distinct neural substrates support model-based and model-free control.
  • Interactions can yield adaptive or maladaptive outcomes.
  • Hierarchical control and social inference are key areas for future research.