Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Cognitive Learning

Cognitive Learning

Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...

Neural Control of Respiration

Neural Control of Respiration

The neural regulation of respiration is a meticulously coordinated process primarily controlled by the respiratory centers located within the brainstem. These centers, composed of specialized neurons, transmit nerve impulses that control the contraction and relaxation of our respiratory muscles.
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...

Neural Regulation

Neural Regulation

Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.

Reinforcement

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:

Associative Learning

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Differential impact of isoflurane on the topological organization of frontoparietal network in macaques.

Cerebral cortex (New York, N.Y. : 1991)·2026

Same author

The prefrontal operculum, a human-specific hub for the cognitive control of speech.

Communications biology·2025

Same author

Motivational control is implemented by a cingulo-prefrontal network.

Current biology : CB·2025

Same author

Why learning progress needs absolute values: Comment on Poli et al. (2024).

The European journal of neuroscience·2024

Same author

Synthesizing the temporal self: robotic models of episodic and autobiographical memory.

Philosophical transactions of the Royal Society of London. Series B, Biological sciences·2024

Same author

Strong and weak alignment of large language models with human values.

Scientific reports·2024

Search research articles

Related Experiment Video

Updated: May 30, 2026

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

Robot cognitive control with a neurophysiologically inspired reinforcement learning model.

Mehdi Khamassi¹, Stéphane Lallée, Pierre Enel

¹Stem Cell and Brain Research Institute, INSERM U846 Bron, France.

Frontiers in Neurorobotics

|August 3, 2011

Summary

This summary is machine-generated.

This study introduces a neurophysiologically inspired model for robots to handle real-world uncertainties. The model enhances robotic adaptability and interaction by integrating cognitive control and reinforcement learning principles.

Keywords:

bio-inspiration humanoid robot iCub meta-learning prefrontal cortex reinforcement learning

More Related Videos

A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

Published on: April 15, 2014

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

Related Experiment Videos

Last Updated: May 30, 2026

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

Published on: April 15, 2014

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

Area of Science:

Robotics
Computational Neuroscience
Cognitive Science

Background:

Robots need to operate outside controlled environments, interacting with humans and dynamic situations.
Primate cognitive systems learn action values and adjust behavior (cognitive control) to manage environmental uncertainty.
Integrating neurophysiological mechanisms of reinforcement learning and cognitive control remains unclear.

Purpose of the Study:

To develop and validate a computational model inspired by primate cortical function for robust robot control.
To investigate how neurophysiological mechanisms of reinforcement learning and cognitive control interact.
To enable robots to handle both expected and unexpected environmental uncertainties.

Main Methods:

A novel computational model integrating lateral prefrontal and anterior cingulate cortex functions was proposed.
The model was implemented in two robotic platforms.
Adaptive regulation of an exploration rate meta-parameter (β) was used to manage uncertainty.

Main Results:

The model successfully handled two types of real-world uncertainties (expected and unexpected).
The model replicated monkey behavioral and neurophysiological data in problem-solving tasks.
Human-robot interaction experiments with the iCub humanoid demonstrated robustness against novel uncertainties, including "cheating".

Conclusions:

Neurophysiologically inspired cognitive systems can effectively control advanced robots in real-world scenarios.
The model provides a framework for understanding the integration of cognitive control and reinforcement learning in biological and artificial systems.
This approach enhances robotic adaptability and interaction capabilities in complex, unpredictable environments.