Related Experiment Video
Updated: Aug 7, 2026

An Open-Source, Fully Customizable 5-Choice Serial Reaction Time Task Toolbox for Automated Behavioral Training of Rodents
Published on: January 19, 2022
In search of the feedback function for variable-interval schedules
Abstract:
Finding a theoretically sound feedback function for variable-interval schedules remains an important unsolved problem. It is important because interval schedules model a significant feature of the world: the dependence of reinforcement on factors beyond the organism's control. The problem remains unsolved because no feedback function yet proposed satisfies all the theoretical and empirical requirements. Previous suggestions that succeed in fitting data fail theoretically because they violate a newly recognized theoretical requirement: The slope of the function must approach or equal 1.0 at the origin. A function is presented that satisfies all requirements but lacks any theoretical justification. This function and two suggested by Prelec and Herrnstein (1978) and Nevin and Baum (1980) are evaluated against several sets of data. All three fitted the data well. The success of the two theoretically incorrect functions raises an empirical puzzle: Low rates of reinforcement are coupled with response rates that seem anomalously high. It remains to be discovered what this reflects about the temporal patterning of operant behavior at low reinforcement rates. A theoretically and empirically correct function derived from basic assumptions about operant behavior also remains to be discovered.
Related Concept Videos
Reinforcement Schedules
Once a behavior is learned,...
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Friedman Two-way Analysis of Variance by Ranks
Interval Level of Measurement
Data measured using the interval scale are similar to ordinal level data because they have a definite arrangement. However, in the interval level of measurement, the differences between data values are meaningful even though the data does not have a starting point.
Temperature is measured using the interval scale. It is measurable data, and the difference between the...
Frequency Response of a Circuit
The transfer function is pivotal in characterizing how these circuits react to various frequencies, facilitating a profound understanding of their behavior. An essential parameter is the time constant, signifying the...
Response Surface Methodology
The process of RSM involves several key steps:

