Orbitofrontal cortical neurons encode expectation-driven initiation of reward-seeking
David E Moorman1, Gary Aston-Jones2
1Department of Neurosciences, Medical University of South Carolina, Charleston, South Carolina 29425 moorman@cns.umass.edu.
Summary
Orbitofrontal cortex (OFC) neuronal activity strongly signals the initiation of reward-seeking behaviors, particularly when reward-predicting cues are present. This activity does not appear to directly relate to response inhibition or extinction learning.
Area of Science:
- Neuroscience
- Behavioral Neuroscience
- Decision Making
Background:
- Adaptive behavior relies on frontal cortical areas for execution and inhibition.
- Medial prefrontal cortex is studied for context-dependent behavior, but orbitofrontal cortex (OFC) roles in response execution/inhibition, especially during extinction learning, are unclear.
- OFC is crucial for reward-guided behavior, yet its neuronal activity during response initiation and inhibition remains poorly understood.
Purpose of the Study:
- To characterize orbitofrontal cortex (OFC) neuronal activity during reward-seeking behavior and extinction learning.
- To investigate the relationship between OFC neural activity and the initiation versus inhibition of responses.
- To determine if OFC activity tracks reward-predicting cues or context-guided response inhibition.
Main Methods:
- Recorded neuronal activity from the orbitofrontal cortex (OFC) in rats.
- Rats performed a discriminative-stimulus (DS)-driven sucrose-seeking task.
- Subsequent extinction phases involved withholding sucrose despite the DS.
Main Results:
- OFC neuronal activity peaked during the initiation of reward-seeking actions, specifically lever pressing and approaching the reward well.
- Activity was strongest when reward-predicting stimuli (RS) reliably predicted sucrose, and weak during nonrewarded stimuli (NS) or extinction.
- OFC neurons shifted selectivity to track rewarded behaviors when cue-outcome contingencies were reversed, but did not show strong signals for response inhibition or extinction.
Conclusions:
- Orbitofrontal cortex (OFC) activity is primarily associated with the initiation of reward-seeking components, driven by predictive cues.
- OFC neuronal activity does not appear to signal extinction learning or response inhibition directly.
- The findings highlight OFC's role in driving motivated actions rather than suppressing them based on context.
Related Concept Videos
Olfaction
40.4K
The sense of smell is achieved through the activities of the olfactory system. It starts when an airborne odorant enters the nasal cavity and reaches olfactory epithelium (OE). The OE is protected by a thin layer of mucus, which also serves the purpose of dissolving more complex compounds into simpler chemical odorants. The size of the OE and the density of sensory neurons varies among species; in humans, the OE is only about 9-10 cm2.
The olfactory receptors are embedded in the cilia of the...
The olfactory receptors are embedded in the cilia of the...
40.4K
Incentive Theory: Pull Theory of Motivation
1.3K
Incentive theory, or the "pull theory" of motivation, suggests that external rewards primarily drive behavior. Individuals are motivated to engage in activities when they anticipate a desirable outcome. This is why people often work hard for promotions or study intensively to achieve high grades. These incentives can be tangible, physical rewards such as money or promotions, or intangible, non-physical rewards like praise and social recognition.
The theory differentiates between...
The theory differentiates between...
1.3K
Association Areas of the Cortex
10.1K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
10.1K
Operant Conditioning
2.6K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
2.6K
Timing and Consequences on Behavior
903
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
903
Law of Effect
5.7K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
5.7K


