Jove
Visualize
Contact Us

Related Concept Videos

Role of Shaping in Operant Conditioning01:19

Role of Shaping in Operant Conditioning

1.3K
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
1.3K
Operant Conditioning Intervention01:24

Operant Conditioning Intervention

738
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
738
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

927
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
927
Behavior Modification01:21

Behavior Modification

1.0K
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
1.0K
Law of Effect01:06

Law of Effect

5.7K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
5.7K
Operant Conditioning01:21

Operant Conditioning

2.6K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
2.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Synchrony timescales underlie irregular neocortical spiking.

Neuron·2025
Same author

Reward-driven adaptation of movements requires strong recurrent basal ganglia-cortical loops.

Proceedings of the National Academy of Sciences of the United States of America·2025
Same author

Neural dynamics outside task-coding dimensions drive decision trajectories through transient amplification.

bioRxiv : the preprint server for biology·2025
Same author

The fluctuation-based regime of thalamocortical circuitry.

bioRxiv : the preprint server for biology·2025
Same author

Connectivity underlying motor cortex activity during goal-directed behaviour.

Nature·2025
Same author

Sharp Waves, Bursts, and Coherence: Activity in a Songbird Vocal Circuit Is Influenced by Behavioral State.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2025
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: May 4, 2026

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze
11:15

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze

Published on: February 20, 2014

14.5K

Interference and shaping in sensorimotor adaptations with rewards.

Ran Darshan1, Arthur Leblois2, David Hansel3

  • 1Edmond and Lily Safra Center for Brain Sciences, The Hebrew University, Jerusalem, Israel ; Laboratoire de Neurophysique et Physiologie UMR8119-CNRS Université René Descartes, Paris, France ; Interdisciplinary Center for Neural Computation, The Hebrew University, Jerusalem, Israel.

Plos Computational Biology
|January 14, 2014
PubMed
Summary
This summary is machine-generated.

Sensorimotor adaptation can be driven by rewards, but multiple targets can cause destructive interference, slowing learning. Smooth rewards and task design can significantly accelerate this adaptation process.

More Related Videos

Study Motor Skill Learning by Single-pellet Reaching Tasks in Mice
06:04

Study Motor Skill Learning by Single-pellet Reaching Tasks in Mice

Published on: March 4, 2014

20.9K
Investigating Motor Skill Learning Processes with a Robotic Manipulandum
07:52

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Published on: February 12, 2017

8.3K

Related Experiment Videos

Last Updated: May 4, 2026

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze
11:15

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze

Published on: February 20, 2014

14.5K
Study Motor Skill Learning by Single-pellet Reaching Tasks in Mice
06:04

Study Motor Skill Learning by Single-pellet Reaching Tasks in Mice

Published on: March 4, 2014

20.9K
Investigating Motor Skill Learning Processes with a Robotic Manipulandum
07:52

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Published on: February 12, 2017

8.3K

Area of Science:

  • Neuroscience
  • Computational Neuroscience
  • Motor Control

Background:

  • Sensorimotor adaptation allows performance maintenance despite perturbations.
  • Adaptation can rely on sensory feedback or reward information.
  • Reward-driven adaptation is possible but less efficient than sensory-based adaptation.

Purpose of the Study:

  • Investigate reward-driven sensorimotor adaptation using a computational model.
  • Analyze the impact of task parameters on learning dynamics.
  • Understand interference effects when adapting to multiple targets.

Main Methods:

  • Developed a minimal computational model of sensorimotor adaptation.
  • Simulated adaptation under varying target numbers, sizes, and reward structures.
  • Analyzed learning dynamics and interference patterns.

Main Results:

  • Multiple targets can lead to destructive interference, slowing adaptation.
  • Adaptation time varies non-linearly with the number of targets due to interference.
  • Smoothly varying rewards reduce interference compared to binary rewards.

Conclusions:

  • Reward-gated synaptic plasticity is key to this adaptation model.
  • Task and reward shaping can mitigate destructive interference and accelerate learning.
  • Further experimental investigation of multi-stimulus reward-driven adaptation is warranted.