Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Role of Shaping in Operant Conditioning01:19

Role of Shaping in Operant Conditioning

1.2K
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
1.2K
Reinforcement Schedules01:24

Reinforcement Schedules

668
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
668
Law of Effect01:06

Law of Effect

5.2K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
5.2K
Instinctive Drift01:05

Instinctive Drift

1.1K
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
1.1K
Primary and Secondary Reinforcers01:23

Primary and Secondary Reinforcers

1.4K
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
1.4K
Reinforcement01:23

Reinforcement

1.1K
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
1.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Beyond the brake: The subthalamic nucleus predominantly facilitates action in non-human primates.

Progress in neurobiology·2026
Same author

Multiple groups of neurons in the superior colliculus convert value signals into saccadic vigor.

iScience·2026
Same author

Lateral habenula and periaqueductal gray neurons signal reward prediction error and continuity of reward expectancy to drive reward-seeking behavior.

Cell reports·2026
Same author

Beyond the Brake: the Subthalamic Nucleus Predominantly Facilitates Action in Non-human Primates.

bioRxiv : the preprint server for biology·2025
Same author

Prefrontal cortex temporally multiplexes slow and fast dynamics in value learning and memory.

Nature communications·2025
Same author

Retrograde optogenetics reveals sensorimotor convergence within a corticotectal pathway of non-human primates.

Current biology : CB·2025
Same journal

Analysis of human visual experience data.

Journal of vision·2026
Same journal

Pyramid-based Bayesian modeling for high-resolution behavioral analysis.

Journal of vision·2026
Same journal

Sensation without perception: The white whale effect and perceptual blindness in autonomous vehicles.

Journal of vision·2026
Same journal

Gaze behavior during closed-captioned movie viewing adapts to absent audio through more frequent switching between text and scene.

Journal of vision·2026
Same journal

In pursuit of saccade awareness: Limited volitional control and minimal conscious access to catch-up saccades during smooth pursuit eye movements.

Journal of vision·2026
Same journal

Dissociable effects of element-lifetime and stimulus-duration on local and global motion processing: An equivalent noise study.

Journal of vision·2026
See all related articles

Related Experiment Video

Updated: Mar 15, 2026

Investigating Motor Skill Learning Processes with a Robotic Manipulandum
07:52

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Published on: February 12, 2017

9.3K

Object-finding skill created by repeated reward experience.

Ali Ghazizadeh, Whitney Griggs, Okihide Hikosaka

    Journal of Vision
    |August 27, 2016
    PubMed
    Summary
    This summary is machine-generated.

    Primates can efficiently find high-value objects among many by using reward history, improving search speed with longer training. This skill is retained long-term, crucial for survival and maximizing rewards.

    More Related Videos

    A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments
    09:43

    A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

    Published on: April 15, 2014

    11.1K
    Novel Object Exploration as a Potential Assay for Higher Order Repetitive Behaviors in Mice
    08:28

    Novel Object Exploration as a Potential Assay for Higher Order Repetitive Behaviors in Mice

    Published on: August 20, 2016

    9.0K

    Related Experiment Videos

    Last Updated: Mar 15, 2026

    Investigating Motor Skill Learning Processes with a Robotic Manipulandum
    07:52

    Investigating Motor Skill Learning Processes with a Robotic Manipulandum

    Published on: February 12, 2017

    9.3K
    A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments
    09:43

    A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

    Published on: April 15, 2014

    11.1K
    Novel Object Exploration as a Potential Assay for Higher Order Repetitive Behaviors in Mice
    08:28

    Novel Object Exploration as a Potential Assay for Higher Order Repetitive Behaviors in Mice

    Published on: August 20, 2016

    9.0K

    Area of Science:

    • Neuroscience
    • Cognitive Science
    • Animal Behavior

    Background:

    • Animal survival hinges on quickly finding rewarding items, yet searching among many distractors is challenging.
    • Primates exhibit neuronal evidence of rapid object differentiation based on reward history.

    Purpose of the Study:

    • To test if robust neural coding of reward history supports efficient, pop-out-like search for high-value objects.
    • To investigate the impact of training duration on object-finding efficiency and memory retention.

    Main Methods:

    • Macaque monkeys (n=4) were trained on objects with biased rewards for varying durations (1, 5, 30+ days).
    • Post-training, subjects searched for a high-value object among numerous low-value objects.
    • Search latency, accuracy, and dependence on display size were measured.

    Main Results:

    • Monkeys accurately and rapidly targeted high-value objects, often with a single saccade (<200 ms latency).
    • Longer reward training significantly reduced search time per item (from 40 ms/item to 16 ms/item).
    • Object-finding skill demonstrated large capacity and long-term memory retention without interference.

    Conclusions:

    • Robust coding of reward history enables efficient, rapid visual search for high-value items in primates.
    • Object-finding efficiency improves with extended reward training, suggesting a learned skill.
    • This value-based search capability, with its capacity and retention, is vital for maximizing rewards and biological fitness.