Related Experiment Video
Updated: May 20, 2026

09:12
Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
Published on: March 17, 2019
Towards a mathematical model of within-session operant responding.
Estêvão G Bittar1, Kleber Del-Claro, Lucas G Bittar
1Department of Zoology, Universidade Federal de Juiz de Fora, Brazil. estevaobittar@hotmail.com
Summary
This study refines a mathematical model explaining changes in operant response rates during experiments. The new model simplifies understanding within-session motivation dynamics by adjusting arousal levels.
Area of Science:
- Behavioral neuroscience
- Mathematical psychology
Background:
- Operant response rates exhibit predictable changes within experimental sessions across species.
- Killeen's (1995) model proposed arousal and satiation dynamics explain these rate changes.
Purpose of the Study:
- Analyze Killeen's (1995) model for within-session response rate changes.
- Develop and test a novel mathematical model for motivation dynamics.
- Simplify the modeling of free-operant response rates.
Main Methods:
- Critically evaluated Killeen's (1995) mathematical model.
- Constructed a new model based on arousal and satiation principles.
- Tested the new model's efficacy in predicting response rates.
Main Results:
- Identified implementation flaws in Killeen's (1995) model.
- The new model successfully captures within-session motivation dynamics.
- Representing arousal as a 0-1 variable yielded a simplified model.
Conclusions:
- Killeen's (1995) model provides a foundation but requires refinement.
- The proposed model offers a more accurate and simpler representation of operant behavior.
- Arousal dynamics are key to understanding within-session response rate variability.
Related Concept Videos
Operant Conditioning Intervention
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Behaviorism
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
Behavior Modification
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
A real-world application of operant conditioning principles is applied...
Role of Shaping in Operant Conditioning
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...

