Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reason and Intuition

Reason and Intuition

The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the brain can only use...

Timing and Consequences on Behavior

Timing and Consequences on Behavior

In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...

Cognitive Learning

Cognitive Learning

Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...

Law of Effect

Law of Effect

B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...

Role of Cerebellum and Prefrontal Cortex in Memory

Role of Cerebellum and Prefrontal Cortex in Memory

The cerebellum, while traditionally associated with motor control, also plays a crucial role in memory, particularly in procedural memory, which involves learning motor tasks that become automatic through repetition. For example, studies have shown that when the cerebellum is damaged, individuals or animals lose the ability to learn conditioned motor responses, such as the conditioned eye-blink response in classical conditioning experiments with rabbits. This study demonstrates the cerebellum's...

Introduction to Biological Bases of Psychology

Introduction to Biological Bases of Psychology

Biopsychology serves as a vital bridge connecting the intricate domains of biology and psychology, shedding light on how biological systems influence psychological phenomena. This field scrutinizes the biological substrates of behavior and mental processes, emphasizing the nervous system along with the roles of neurotransmitters, hormones, and genetics. It also incorporates evolutionary perspectives to explain the adaptive nature of mental functions.
The nervous system, the cornerstone of...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Model-based and model-free valuation signals in the human brain vary markedly in relation to individual differences in behavioral control.

Cell reports·2026

Same author

The control of goal-directed actions by nutrient-specific appetites and rewards.

Appetite·2026

Same author

Individual Brain Charting: fifth release of high-resolution fMRI data for cognitive mapping.

Scientific data·2026

Same author

The representation and valuation of subgoals in the human brain during model-based hierarchical behavior.

Neuron·2026

Same author

Extraction of robust functional connectivity patterns across psychiatric disorders using principal component analysis-based feature selection.

Imaging neuroscience (Cambridge, Mass.)·2026

Same author

Computational and neural mechanisms underlying the influence of action affordances on value learning.

Nature communications·2026

Search research articles

Related Experiment Video

Updated: Jul 4, 2026

The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients

The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients

Published on: June 12, 2020

Calculating consequences: brain systems that encode the causal effects of actions.

Saori C Tanaka¹, Bernard W Balleine, John P O'Doherty

¹Division of the Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA.

The Journal of Neuroscience : the Official Journal of the Society for Neuroscience

|June 27, 2008

Summary

This study shows how the brain evaluates action effectiveness. Neural activity in key brain regions tracks how actions cause rewards, aiding adaptive behavior in changing environments.

More Related Videos

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents

An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents

Published on: August 2, 2018

Related Experiment Videos

Last Updated: Jul 4, 2026

The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients

The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients

Published on: June 12, 2020

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents

An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents

Published on: August 2, 2018

Area of Science:

Neuroscience
Cognitive Science
Decision Making

Background:

Adaptive behavior relies on evaluating action-reward relationships.
Understanding the neural basis of causal inference is crucial for explaining behavioral flexibility.

Purpose of the Study:

To investigate the neural mechanisms underlying the computation of action-outcome contingency.
To examine how the brain assesses the causal effectiveness of actions in dynamic environments.

Main Methods:

Functional magnetic resonance imaging (fMRI) was used to scan participants.
Participants performed a task involving button presses to earn money with changing response-reward contingencies.
Behavioral judgments of action efficacy were recorded.

Main Results:

Subjective judgments of causal efficacy correlated with objective response-reward contingency.
Neural activity in the medial orbitofrontal cortex and dorsomedial striatum increased when actions were highly causal.
Medial prefrontal cortex activity reflected real-time changes in action-outcome correlations.

Conclusions:

Distinct brain regions are involved in computing action-outcome contingency.
These neural computations support the adaptive control of behavior in response to environmental changes.