Competitive integration of time and reward explains value-sensitive foraging decisions and frontal cortex ramping

Michael Bukwich1,2,3, Malcolm G Campbell1,2, David Zoltowski4,5

  • 1Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, 02138.

Abstract

Related Concept Videos

Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
114
Optimal Arousal Theory01:23

Optimal Arousal Theory

The optimal arousal theory suggests that performance is maximized when an individual experiences a moderate level of arousal. This theory is closely tied to the Yerkes-Dodson law, which illustrates an inverted U-shaped relationship between arousal and performance. The law, formulated by psychologists Robert Yerkes and John Dodson, implies an ideal arousal level for optimal performance, and deviations from this level can lead to declines in effectiveness.
Inverted U-Shaped Performance Curve
The...
215
Compensation Mechanisms01:28

Compensation Mechanisms

The human body employs intricate mechanisms to counteract changes in blood pH, preventing conditions like acidosis (pH < 7.35) and alkalosis (pH > 7.45). These compensatory responses aim to restore normal arterial blood pH by engaging respiratory or renal systems, depending on the source of the imbalance.
Respiratory Compensation
This mechanism addresses metabolic-induced pH imbalances by adjusting breathing rates. Respiratory compensation begins within minutes of detecting a pH...
390
Reinforcement Schedules01:24

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
197
Biological Clocks and Seasonal Responses02:45

Biological Clocks and Seasonal Responses

The circadian—or biological—clock is an intrinsic, timekeeping, molecular mechanism that allows plants to coordinate physiological activities over 24-hour cycles called circadian rhythms. Photoperiodism is a collective term for the biological responses of plants to variations in the relative lengths of dark and light periods. The period of light-exposure is called the photoperiod.
34.7K