Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reinforcement Schedules01:24

Reinforcement Schedules

709
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
709
Reinforcement01:23

Reinforcement

1.2K
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
1.2K
Primary and Secondary Reinforcers01:23

Primary and Secondary Reinforcers

1.7K
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
1.7K
NMR Spectrometers: Radiofrequency Pulses and Pulse Sequences01:17

NMR Spectrometers: Radiofrequency Pulses and Pulse Sequences

1.8K
A pulse is a short burst of radio waves distributed over a range of frequencies that simultaneously excites all the nuclei in the sample. Upon passing a radio frequency pulse along the x-axis, the nuclei absorb energy corresponding to their Larmor frequencies and achieve resonance. This shifts the net magnetization vector from the z-axis toward the transverse plane. This angle of rotation of the magnetization vector, or the flip angle, is proportional to the duration and intensity of the pulse.
1.8K
Regulation of Pulse01:20

Regulation of Pulse

2.4K
Pulse regulation involves physiological mechanisms that ensure adequate blood flow throughout the body. The heartbeat, regulated by the autonomic nervous system, is influenced by hormonal balance, physical activity, and emotional state.
2.4K
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

866
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
866

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Demand for heroin in rats: effects of non-drug alternative substitutes and complements.

Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology·2025
Same author

Time costs in the demand for cigarettes assessed using the cigarette purchase task-time (CPT-T).

Experimental and clinical psychopharmacology·2025
Same author

Resurgence in a discrete-trial procedure in rats.

Journal of the experimental analysis of behavior·2024
Same author

An investigation of economic interactions between social reinforcement and heroin or cocaine in rats.

Behavioural pharmacology·2024
Same author

No evidence tube entrapment distresses rodents in typical empathy tests.

Animal cognition·2024
Same author

Cocaine and heroin interact differently with nondrug reinforcers in a choice situation.

Experimental and clinical psychopharmacology·2023
Same journal

The Genoeconomics of Impulsive Intertemporal Choice: A Critical Review.

Journal of the experimental analysis of behavior·2026
Same journal

Shaping the extinction burst: Increasing its probability and preventing its emergence across topographies.

Journal of the experimental analysis of behavior·2026
Same journal

Evaluating the combined effects of effort and probability on monetary discounting.

Journal of the experimental analysis of behavior·2026
Same journal

An improved translational approach to studying persistence-strengthening effects of differential reinforcement of alternative behavior.

Journal of the experimental analysis of behavior·2026
Same journal

Interactions between the effects of food and water motivating operations on concurrent food- and water-reinforced responding in mice.

Journal of the experimental analysis of behavior·2026
Same journal

Odor-visual and visual-visual matching to sample with dogs.

Journal of the experimental analysis of behavior·2026
See all related articles

Related Experiment Video

Updated: Apr 23, 2026

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

9.5K

Preference pulses induced by reinforcement.

Yosuke Hachiga1, Takayuki Sakagami, Alan Silberberg

  • 1Keio University.

Journal of the Experimental Analysis of Behavior
|October 2, 2014
PubMed
Summary
This summary is machine-generated.

Rats showed decreased preference for a lever when it delivered no food (extinction). However, preference remained high if the lever quickly returned to providing food, demonstrating rapid adaptation in reinforcement learning.

Keywords:
arousalchoiceinductionlever presspreference pulseratswin-stay

More Related Videos

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

5.2K
Developing a Behavioral Box for Assessing Prepulse Inhibition and Neural Activity in Psychiatric Animal Models
06:55

Developing a Behavioral Box for Assessing Prepulse Inhibition and Neural Activity in Psychiatric Animal Models

Published on: July 22, 2025

884

Related Experiment Videos

Last Updated: Apr 23, 2026

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

9.5K
Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

5.2K
Developing a Behavioral Box for Assessing Prepulse Inhibition and Neural Activity in Psychiatric Animal Models
06:55

Developing a Behavioral Box for Assessing Prepulse Inhibition and Neural Activity in Psychiatric Animal Models

Published on: July 22, 2025

884

Area of Science:

  • Behavioral Psychology
  • Animal Behavior Studies

Background:

  • Operant conditioning involves learning through consequences.
  • Reinforcement schedules significantly influence response rates and choice behavior.

Purpose of the Study:

  • To investigate how rats adjust their lever-press preferences under concurrent variable-ratio (VR) and extinction schedules.
  • To examine the role of reinforcer-induced arousal in short-term preference changes.

Main Methods:

  • Eight rats were trained on concurrent VR 20 and extinction schedules for food.
  • Reinforcement contingencies were randomly switched between left and right levers, signaled by lights.
  • Preference for each lever was measured over time.

Main Results:

  • A significant decrease in lever preference was observed when a lever switched to extinction.
  • This preference decrease was minimal if the lever rapidly returned to a VR schedule.
  • Results align with an induction model explaining preference shifts.

Conclusions:

  • Preference shifts are influenced by the immediate history of reinforcement and extinction.
  • Reinforcer-induced arousal may temporarily energize responding to the previously rewarded lever.
  • Stimulus cues play a crucial role in re-establishing operant control after arousal dissipates.