Modeling VI and VDRL feedback functions: Searching normative rules through computational simulation

Area of Science:

• Behavioral science
• Quantitative psychology
• Mathematical psychology

Background:

• Understanding reinforcement schedules is crucial in behavioral science.
• Existing models for feedback functions in schedules of reinforcement require further refinement.
• Simulations offer a precise method for analyzing behavioral data without confounding factors.

Purpose of the Study:

• To mathematically describe feedback functions for variable interval and variable differential reinforcement of low rates schedules.
• To assess and compare different reinforcement feedback functions using simulation data.
• To introduce Beak, an R script designed for simulating behavior under reinforcement schedules.

Main Methods:

• Development of an R script named Beak to simulate behavioral responses under various schedules of reinforcement.
• Generation of large datasets through simulation to precisely assess feedback functions.
• Systematic variation of response rates in simulated behavior to analyze reinforcement effects.

Main Results:

• The feedback function proposed by Baum (1981) is identified as optimal for random interval schedules.
• The model proposed by Killeen (1975) is suggested as a viable feedback function for random differential reinforcement of low rates schedules.
• Beak provides unparalleled precision in simulating behavioral data, allowing for systematic analysis.

Conclusions:

• Beak facilitates a deeper understanding of the quantitative aspects of simple schedules of reinforcement.
• The identified feedback functions enhance the precision and applicability of reinforcement schedule models.
• Beak can guide future experimental research utilizing schedules of reinforcement as theoretical and methodological tools.