Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Instinctive Drift01:05

Instinctive Drift

Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
Reinforcement01:23

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Cognitive Learning01:21

Cognitive Learning

Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
Purposive Learning01:22

Purposive Learning

E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a bonus...
Incentive Theory: Pull Theory of Motivation01:18

Incentive Theory: Pull Theory of Motivation

Incentive theory, or the "pull theory" of motivation, suggests that external rewards primarily drive behavior. Individuals are motivated to engage in activities when they anticipate a desirable outcome. This is why people often work hard for promotions or study intensively to achieve high grades. These incentives can be tangible, physical rewards such as money or promotions, or intangible, non-physical rewards like praise and social recognition.
The theory differentiates between intrinsic and...
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Data-driven inverse optimal control for continuous-time nonlinear systems.

ISA transactions·2025
Same author

A computational model of canonical cortical microcircuits for dynamic Bayesian inference and control as inference.

Neuroscience research·2025
Same author

Possible contribution to data-driven primate research: Comment on "Kinematic coding: Measuring information in naturalistic behaviour" by Becchio, Pullar, Scaliti, and Panzeri.

Physics of life reviews·2025
Same author

Optical Neuroimage Studio (OptiNiSt): Intuitive, scalable, extendable framework for optical neuroimage data analysis.

PLoS computational biology·2025
Same author

Information-Theoretical Analysis of Team Dynamics in Football Matches.

Entropy (Basel, Switzerland)·2025
Same author

The differential effect of optogenetic serotonergic manipulation on sustained motor actions and waiting for future rewards in mice.

Frontiers in neuroscience·2024

Related Experiment Video

Updated: Jun 27, 2026

Investigating Motor Skill Learning Processes with a Robotic Manipulandum
07:52

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Published on: February 12, 2017

Finding intrinsic rewards by embodied evolution and constrained reinforcement learning.

Eiji Uchibe1, Kenji Doya

  • 1Okinawa Institute of Science and Technology, Okinawa 904-2234, Japan. uchibe@oist.jp

Neural Networks : the Official Journal of the International Neural Network Society
|November 18, 2008
PubMed
Summary
This summary is machine-generated.

This study introduces a novel method for designing intrinsic rewards in autonomous agents, combining reinforcement learning and embodied evolution. Experiments show robots learn to approach key environmental cues, enhancing task acquisition.

More Related Videos

Pavlovian Conditioned Approach Training in Rats
06:57

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

Studying Food Reward and Motivation in Humans
12:09

Studying Food Reward and Motivation in Humans

Published on: March 19, 2014

Related Experiment Videos

Last Updated: Jun 27, 2026

Investigating Motor Skill Learning Processes with a Robotic Manipulandum
07:52

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Published on: February 12, 2017

Pavlovian Conditioned Approach Training in Rats
06:57

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

Studying Food Reward and Motivation in Humans
12:09

Studying Food Reward and Motivation in Humans

Published on: March 19, 2014

Area of Science:

  • Artificial Intelligence
  • Neuroscience
  • Robotics

Background:

  • Designing effective reward functions is crucial for autonomous agents in AI and neuroscience.
  • Task acquisition often necessitates rewards for intermediate states to encourage exploration.
  • Current methods face challenges in creating comprehensive reward systems for complex behaviors.

Purpose of the Study:

  • To propose a novel method for designing intrinsic rewards for autonomous agents.
  • To integrate constrained policy gradient reinforcement learning with embodied evolution.
  • To validate the proposed method using physical robotic systems.

Main Methods:

  • Utilized a combination of constrained policy gradient reinforcement learning and embodied evolution.
  • Employed Cyber Rodent robots equipped with sensors and actuators for interaction.
  • Defined extrinsic rewards for collision avoidance, battery recharging, and software reproduction ('mating').

Main Results:

  • Hardware experiments demonstrated the successful design of intrinsic rewards.
  • Autonomous agents learned to associate visual cues (battery packs, other robots) with intrinsic rewards.
  • The intrinsic rewards promoted approach behaviors towards essential environmental elements.

Conclusions:

  • The proposed method effectively generates intrinsic rewards that guide agent behavior.
  • This approach enhances exploration and task acquisition in autonomous systems.
  • The findings have implications for developing more sophisticated AI and robotic agents.