Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Role of Shaping in Operant Conditioning01:19

Role of Shaping in Operant Conditioning

331
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
331
Behavior Modification01:21

Behavior Modification

175
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
175
Operant Conditioning Intervention01:24

Operant Conditioning Intervention

58
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
58
Modeling in Therapy01:26

Modeling in Therapy

86
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
86
Behaviorism01:28

Behaviorism

2.3K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.3K
Behavior Therapy01:22

Behavior Therapy

52
Behavior therapy incorporates diverse techniques rooted in classical conditioning principles to address maladaptive behaviors and anxiety disorders. These methods aim to reduce avoidance behaviors, foster adaptive coping mechanisms, and alter associations between stimuli and responses, making them effective in a wide range of therapeutic contexts.
Exposure therapy is a cornerstone of behavioral treatment for anxiety disorders. It involves systematic exposure to feared stimuli, either in real...
52

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Perception and neural representation of intermittent odor stimuli in mice.

Nature communications·2026
Same author

Inferring genotype-phenotype maps using attention models.

PNAS nexus·2026
Same author

Convergent motifs of early olfactory processing are recapitulated by layer-wise efficient coding.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Sparse input representations explain odor discrimination in complex, concentration-varying mixtures.

bioRxiv : the preprint server for biology·2026
Same author

Phenotypic heterogeneity in lag reflects an evolutionarily stable bet-hedging strategy.

bioRxiv : the preprint server for biology·2025
Same author

Simultaneous detection and estimation in olfactory sensing.

bioRxiv : the preprint server for biology·2025
Same journal

Layered social competition coordinates reproductive hierarchy formation in ants.

bioRxiv : the preprint server for biology·2026
Same journal

Combination epigenetic-targeted therapy increases the immunogenicity of poorly immunogenic sarcomas.

bioRxiv : the preprint server for biology·2026
Same journal

Loss of LanC-like proteins delays post-injury regeneration of aging skeletal muscles.

bioRxiv : the preprint server for biology·2026
Same journal

Integrative Transfer Network: Deep Transfer Learning Across Populations and Prediction Targets.

bioRxiv : the preprint server for biology·2026
Same journal

Confidence-supported label-free metabolic imaging with FPhaS phase autofluorescence microscopy.

bioRxiv : the preprint server for biology·2026
Same journal

Sequence-encoded autoinhibition couples mRNA decapping activity to phase separation.

bioRxiv : the preprint server for biology·2026
See all related articles

Related Experiment Video

Updated: Jul 8, 2025

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze
11:15

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze

Published on: February 20, 2014

13.1K

Adaptive algorithms for shaping behavior.

William L Tong1, Anisha Iyer2, Venkatesh N Murthy3

  • 1School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA.

Biorxiv : the Preprint Server for Biology
|December 18, 2023
PubMed
Summary
This summary is machine-generated.

This study introduces a machine learning framework for animal behavior shaping. It uses an autonomous agent to adaptively adjust task difficulty, balancing learning and preventing frustration for effective training.

More Related Videos

A Treatment Package without Escape Extinction to Address Food Selectivity
04:23

A Treatment Package without Escape Extinction to Address Food Selectivity

Published on: August 21, 2015

11.6K
Author Spotlight: Exploring Autism Spectrum Disorder Symptoms in Fruit Flies — Genetic Models and Behavioral Tests
08:30

Author Spotlight: Exploring Autism Spectrum Disorder Symptoms in Fruit Flies — Genetic Models and Behavioral Tests

Published on: September 6, 2024

1.7K

Related Experiment Videos

Last Updated: Jul 8, 2025

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze
11:15

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze

Published on: February 20, 2014

13.1K
A Treatment Package without Escape Extinction to Address Food Selectivity
04:23

A Treatment Package without Escape Extinction to Address Food Selectivity

Published on: August 21, 2015

11.6K
Author Spotlight: Exploring Autism Spectrum Disorder Symptoms in Fruit Flies — Genetic Models and Behavioral Tests
08:30

Author Spotlight: Exploring Autism Spectrum Disorder Symptoms in Fruit Flies — Genetic Models and Behavioral Tests

Published on: September 6, 2024

1.7K

Area of Science:

  • Animal Behavior
  • Machine Learning
  • Reinforcement Learning

Background:

  • Animal training commonly uses shaping, a curriculum of simpler tasks.
  • Effective shaping principles are not fully understood.

Purpose of the Study:

  • To propose a machine learning framework for shaping animal behavior.
  • To develop an adaptive shaping heuristic for efficient training.

Main Methods:

  • An autonomous teacher agent was developed to select tasks based on student performance.
  • The framework was tested on sequence learning and deep reinforcement learning navigation tasks.

Main Results:

  • Near-optimal shaping algorithms adaptively balance reinforcement and extinction by alternating task difficulty.
  • The derived heuristic is near-optimal for sequence learning and robust for navigation tasks with sparse rewards.

Conclusions:

  • The proposed framework offers a computational approach to optimizing animal behavior shaping.
  • This work lays groundwork for generalizable computational frameworks in animal training.