Jove
Visualize
Contact Us

Related Experiment Videos

The operant reserve: a computer simulation in (accelerated) real time.

A Charles Catania1

  • 1Department of Psychology [corrected] University of Maryland [corrected] Baltimore County (UMBC), Baltimore [corrected] MD 21250 [corrected] USA. catania@umbc.edu [corrected]

Behavioural Processes
|April 23, 2005
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Urcuioli's differential-outcomes research: Implications for our behavioral units.

Journal of the experimental analysis of behavior·2025
Same author

Prolegomena to any future philosophy of behavior analysis as a science.

Journal of the experimental analysis of behavior·2023
Same author

Faustian bargains: Short-term and long-term contingencies in phylogeny, ontogeny, and sociogeny.

Journal of the experimental analysis of behavior·2022
Same author

Tactical contingencies in the experimental analysis of reinforcement and operant classes.

Journal of the experimental analysis of behavior·2020
Same author

Establishing terms: A commentary on Edwards, Lotfizadeh & Poling's "Motivating operations and stimulus control".

Journal of the experimental analysis of behavior·2019
Same author

A quantitative analysis of the behavior maintained by delayed reinforcers.

Journal of the experimental analysis of behavior·2015
Same journal

Sex and brain maturation underlie the attribution of incentive salience to conditioned stimuli in Wistar rats.

Behavioural processes·2026
Same journal

Shining a light on jellyfish behaviour: Enhanced motor activity and positive phototaxis in Aurelia coerulea.

Behavioural processes·2026
Same journal

Detour-task performance in color polymorphic male mosquitofish.

Behavioural processes·2026
Same journal

Behavioral and physiological changes during the estrous cycle of socially housed female guinea pigs.

Behavioural processes·2026
Same journal

Flexible time-series analysis: A dynamically aware method for inferring directed dependencies in behavioral data.

Behavioural processes·2026
Same journal

Effects of group size and landmarks on escape behavior of three fish species.

Behavioural processes·2026
See all related articles
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

This study enhances Skinner's Reflex Reserve theory by proposing that reinforcement depends on multiple prior responses, not just the last. This revised model accurately predicts behavior across various reinforcement schedules.

Area of Science:

  • Behavioral psychology
  • Computational neuroscience
  • Reinforcement learning

Background:

  • Skinner's Reflex Reserve theory posits that responses deplete a reserve, which is replenished by reinforcement.
  • The original theory struggled to explain why partial reinforcement yields higher response rates than continuous reinforcement.

Purpose of the Study:

  • To modify Skinner's Reflex Reserve theory to account for partial reinforcement effects.
  • To develop a computational model simulating response dynamics under different reinforcement schedules.

Main Methods:

  • A computer simulation was developed where response probability is proportional to reserve size.
  • Each response decrements the reserve, and reinforcement increments it based on the weighted delay of preceding responses.

Related Experiment Videos

Main Results:

  • The simulation successfully replicated cumulative records and quantitative data for various schedules (extinction, random-ratio, random-interval).
  • The model accurately predicted performance transitions and historical effects, aligning with empirical observations.

Conclusions:

  • The modified Reflex Reserve model, incorporating weighted delays of prior responses, provides a more robust explanation for reinforcement phenomena.
  • This computational approach offers a framework for extending the theory to complex behavioral scenarios.