Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Cognitive Learning01:21

Cognitive Learning

94
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
94
Reinforcement01:23

Reinforcement

152
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
152

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Exposure to false cardiac feedback alters pain perception and anticipatory cardiac frequency.

eLife·2026
Same author

Gaze dynamics prior to navigation support hierarchical planning.

PloS one·2026
Same author

Limb apraxia and active inference in the visuomotor pathways.

Psychonomic bulletin & review·2026
Same author

The continuous dynamics of planning and acting in a virtually embodied task.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Eye of the beholder: Pupillary response reflects how subjective prior beliefs shape reinforcement learning with fake news.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

False but phonologically plausible linguistic priors induce cross-linguistic auditory illusions and attenuate electrophysiological markers of surprise.

Imaging neuroscience (Cambridge, Mass.)·2026

Related Experiment Video

Updated: May 10, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.3K

Meta-Reinforcement Learning reconciles surprise, value, and control in the anterior cingulate cortex.

Tim Vriens1, Eliana Vassena2,3, Giovanni Pezzulo1

  • 1Institute of Cognitive Sciences and Technologies, CNR, Rome, Italy.

Plos Computational Biology
|April 22, 2025
PubMed
Summary

The dorsal anterior cingulate cortex (dACC) optimizes cognitive control through meta-learning, integrating surprise tracking and performance monitoring functions. This novel framework resolves debates on dACC

More Related Videos

Investigating the Function of Deep Cortical and Subcortical Structures Using Stereotactic Electroencephalography: Lessons from the Anterior Cingulate Cortex
09:00

Investigating the Function of Deep Cortical and Subcortical Structures Using Stereotactic Electroencephalography: Lessons from the Anterior Cingulate Cortex

Published on: April 15, 2015

12.2K
The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents
09:01

The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents

Published on: July 8, 2015

12.4K

Related Experiment Videos

Last Updated: May 10, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.3K
Investigating the Function of Deep Cortical and Subcortical Structures Using Stereotactic Electroencephalography: Lessons from the Anterior Cingulate Cortex
09:00

Investigating the Function of Deep Cortical and Subcortical Structures Using Stereotactic Electroencephalography: Lessons from the Anterior Cingulate Cortex

Published on: April 15, 2015

12.2K
The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents
09:01

The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents

Published on: July 8, 2015

12.4K

Area of Science:

  • Neuroscience
  • Cognitive Neuroscience
  • Computational Neuroscience

Background:

  • The dorsal anterior cingulate cortex (dACC) role in cognition is debated, with theories focusing on cognitive control or monitoring.
  • Existing research presents conflicting findings, creating a theoretical impasse regarding dACC function.
  • Current models fail to reconcile dACC's involvement in both surprise tracking and cognitive control tasks.

Purpose of the Study:

  • To propose a unifying hypothesis for dACC function integrating cognitive control and monitoring perspectives.
  • To introduce a meta-Reinforcement Learning framework where cognitive control is optimized by meta-learning based on Bayesian surprise.
  • To resolve the theoretical crisis surrounding dACC function in cognitive neuroscience.

Main Methods:

  • Development of a novel meta-Reinforcement Learning hypothesis for dACC function.
  • Testing quantitative predictions of the hypothesis using three functional neuroimaging experiments.
  • Analyzing neuroimaging data to assess the framework's ability to explain dACC activation patterns.

Main Results:

  • The meta-Reinforcement Learning framework successfully predicted dACC activation in both cognitive control and monitoring tasks.
  • The proposed model reconciles previously conflicting findings in the dACC literature.
  • Bayesian surprise tracking was identified as a key mechanism for optimizing cognitive control via meta-learning.

Conclusions:

  • dACC function can be understood as a meta-learning optimization of cognitive control.
  • The meta-Reinforcement Learning framework provides an integrative perspective on dACC's roles in cognitive control, surprise tracking, and performance monitoring.
  • This study offers a resolution to the long-standing theory crisis regarding dACC function.