A neuromorphic circuit with variable behavioral reinforcement intensity based on operant conditioning

Upon exposure to complex environments, operant conditioning serves as an effective protective mechanism for organisms. The intensity of behavioral responses can be modulated through reinforcement or punishment following specific actions, thereby facilitating adaptive protection. Notably, intermittent stimulation exerts a significant influence on this process. Specifically, intermittent reinforcement fosters behavioral patterns characterized by greater persistence and resistance to extinction. In this study, an operant conditioning circuit with a variable behavior reinforcement intensity was designed. The circuit consists of pressing module, reward module, punishment module, and synapse module. The circuit is designed based on the psychological phenomenon of partial reinforcement and mechanisms such as the effectiveness of punishment. It achieves control over the reinforcement and inhibition effect of behavior by adjusting the frequency of reward and punishment in operant conditioning. Additionally, hunger sensation and sensitivity circuits are incorporated into the system, allowing the circuit to exhibit a certain level of adaptation to repeated reward and punishment stimuli during the processes of behavior reinforcement and inhibition. Finally, the functionality described above was validated through simulation in Pspice. Based on the implementation of these functions, the circuit is closer to practical applications, better aligns with biological characteristics, and is capable of adapting to more complex scenarios. It provides further insights for the continued development of neural networks in operant conditioning.