Related Experiment Video

Updated: Aug 9, 2026

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

Feedback functions, optimization, and the relation of response rate to reinforcer rate

Paul L Soto1, Jack J McDowell, Jesse Dallery

  • 1Department of Psychology, University of Florida, Gainesville, Florida 32611, USA. psoto@ufl.edu

Journal of the Experimental Analysis of Behavior
|April 11, 2006
PubMed

More Related Videos

Progressive-ratio Responding for Palatable High-fat and High-sugar Food in Mice11:16

Progressive-ratio Responding for Palatable High-fat and High-sugar Food in Mice

Published on: May 3, 2012

Modeling Verbal Behavior Deficits with the Stimulus Control Ratio Equation, SCoRE06:57

Modeling Verbal Behavior Deficits with the Stimulus Control Ratio Equation, SCoRE

Published on: May 14, 2019

Related Concept Videos

Reinforcement Schedules01:24

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Law of Effect01:06

Law of Effect

B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Dose-Response Relationship: Overview01:03

Dose-Response Relationship: Overview

Agonists can bind with and activate receptors, resulting in the formation of drug-receptor complexes. Once formed, these complexes catalyze many biochemical processes at the cellular level and subsequently induce a pharmacologic response. The degree of response is directly proportional to the fraction of activated receptors, which in turn, depends on the concentration of the drug at the receptor site as well as the sensitivity of the receptor. An increase in the administered dose contributes to...
Operant Conditioning01:21

Operant Conditioning

Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Effects of feedback01:24

Effects of feedback

Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...