Related Experiment Video
Updated: Jul 4, 2026

Performing Behavioral Tasks in Subjects with Intracranial Electrodes
Published on: October 2, 2014
Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game
1Department of Neurobiology, Yale University School of Medicine, New Haven, Connecticut 06510, USA.
This study examines how monkeys make decisions in competitive games. Researchers found that specific brain cells track past rewards to help guide future choices. These findings suggest the brain evaluates outcomes by comparing current results to previous experiences.
Area of Science:
- Neuroscience research within dorsal anterior cingulate cortex dynamics
- Behavioral economics and reinforcement learning in primate models
Background:
No prior work had resolved how neural signals integrate historical feedback during competitive interactions. It was already known that the anterior cingulate cortex facilitates behavioral adjustments when environmental contingencies shift. Prior research has shown that specific neurons within this region represent anticipated or realized gains. That uncertainty drove the need to determine if reward-related neural firing depends on past experiences. Previous investigations established that decision-making processes are adaptive and optimized through experience. This gap motivated an inquiry into whether temporal factors influence cortical reward processing. Researchers have long recognized the importance of this brain area in updating strategies. No previous study had fully characterized the temporal filtering of these signals during mixed-strategy tasks.
Purpose Of The Study:
The study aimed to determine if reward-related activity in the dorsal anterior cingulate cortex is influenced by previous reward history. This investigation addressed how the brain adapts to dynamic environments through experience. Researchers sought to clarify the role of this cortical area in updating behavioral strategies. The team hypothesized that temporal filtering of signals might optimize choice outcomes. This inquiry focused on whether neurons encode reward rates or prediction errors over time. The project was motivated by the need to understand the neural basis of adaptive decision-making. No prior work had resolved the specific influence of past rewards on current neural firing in this region. This research provides a framework for understanding how historical feedback shapes subjective evaluation.
Main Methods:
The team employed a behavioral paradigm involving rhesus monkeys performing binary choices. This setup simulated a competitive zero-sum game to elicit strategic decision-making. Researchers recorded single-unit activity from the dorsal anterior cingulate cortex during these tasks. The approach involved comparing neural firing rates against the history of received rewards. This review approach synthesized data to identify modulation patterns across sequential trials. Statistical models assessed the relationship between neural responses and reward prediction errors. The experimental design ensured that choice behavior remained close to optimal strategies. This methodology allowed for the isolation of temporal filtering effects on reward-related signals.
Main Results:
The primary finding indicates that reward-related neural activity is significantly modulated by the history of previous outcomes. Some neurons encoded the cumulative rate of rewards from preceding trials. Other units displayed firing patterns closely associated with reward prediction errors. The study observed that choice-related signals were represented only weakly within this cortical region. Behavioral analysis revealed small systematic biases consistent with reinforcement learning algorithms. These monkeys maintained performance levels relatively close to optimal competitive strategies. The data show that neural responses integrate information across multiple trials rather than reflecting only the current outcome. This temporal filtering provides a mechanism for the subjective evaluation of choices in dynamic environments.
Conclusions:
The authors propose that neurons in the dorsal anterior cingulate cortex participate in evaluating choice outcomes. This evaluation appears dependent upon the history of previous gains. Some cells track the frequency of past rewards over time. Other units show activity patterns linked to reward prediction errors. The findings suggest that this cortical region integrates historical data to inform future actions. These results support the idea that the brain uses reinforcement learning principles during competitive tasks. The study highlights that choice-related information is only minimally represented in this specific area. These observations imply a specialized role for the dorsal anterior cingulate cortex in subjective outcome assessment.
Frequently Asked Questions
The researchers propose that dorsal anterior cingulate cortex neurons evaluate outcomes by integrating current rewards with historical data. Some cells track the frequency of past gains, while others represent reward prediction errors, demonstrating a temporal filtering mechanism during competitive decision-making.
The study utilized rhesus monkeys trained to perform binary choices within a computer-simulated zero-sum game. This experimental design allowed the team to observe how subjects adjusted their strategies against a simulated opponent.
The dorsal anterior cingulate cortex is necessary because it serves as a site for subjective evaluation of outcomes. Unlike other cortical regions, this area specifically modulates reward-related firing based on previous trial history, which is required for adaptive behavioral adjustments.
The researchers analyzed single-neuron activity data to determine how firing patterns correlated with past reward history. This quantitative approach revealed that neural responses were modulated by previous outcomes rather than just the immediate trial result.
The team measured systematic biases in choice behavior that aligned with reinforcement learning algorithms. These biases indicate that the monkeys were not choosing randomly but were instead optimizing their actions based on past successes.
The authors suggest that their findings imply a functional specialization where this cortical area prioritizes outcome evaluation over the representation of individual choices. This distinction helps clarify how the brain updates behavioral strategies in dynamic environments.
More Related Videos
07:05Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
Published on: September 10, 2018
08:24The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
Published on: August 25, 2023