Reward stability determines the contribution of orbitofrontal cortex to adaptive behavior

Justin S Riceberg1, Matthew L Shapiro

  • 1Fishberg Department of Neuroscience and Alfred B. and Gudrun J. Kastor Neurobiology of Aging Laboratories, Mount Sinai School of Medicine, New York, New York 10029-5674, USA.

Summary

The orbitofrontal cortex (OFC) is crucial for flexible behavior. OFC lesions impair reward learning when reward rules change frequently, highlighting its role in adapting to unstable environments.

Related Concept Videos

Operant Conditioning01:21

Operant Conditioning

Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Operant Conditioning Intervention01:24

Operant Conditioning Intervention

Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
Functional Brain Systems: Reticular Formation01:13

Functional Brain Systems: Reticular Formation

The reticular formation is a complex network of gray and white matter located within the brainstem extending from the medulla to the midbrain.
Within the reticular formation, there are several distinct nuclei that can be classified into three broad categories. The Raphe nuclei are located along the midline of the brainstem. They are primarily known for their role in synthesizing and releasing serotonin, a neurotransmitter involved in regulating mood, appetite, sleep, and circadian rhythms. The...
Law of Effect01:06

Law of Effect

B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Self-Regulation01:25

Self-Regulation

Self-regulation, also known as self-control, encompasses a range of cognitive and behavioral processes that allow individuals to adjust their internal states and outward actions to align with socially acceptable norms and long-term goals. It plays a fundamental role in adaptive functioning, from resisting impulsive behaviors to persisting through challenging tasks. While its benefits are widely recognized, self-regulation is not limitless. Muraven and Baumeister's theory posits that...