Related Experiment Video
Updated: Jul 13, 2025

07:33
Optogenetic Entrainment of Hippocampal Theta Oscillations in Behaving Mice
Published on: June 29, 2018
11.8K
Human thalamic low-frequency oscillations correlate with expected value and outcomes during reinforcement learning
Antoine Collomb-Clerc1, Maëlle C M Gueguen1,2, Lorella Minotti1,3
1Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France.
Nature Communications
|October 17, 2023
Summary
The human thalamus, specifically the anterior and dorsomedial regions, plays a key role in reinforcement learning. Low frequency oscillations in these areas track expected value and prediction errors during decision-making.
Area of Science:
- Neuroscience
- Cognitive Science
- Computational Neuroscience
Background:
- Reinforcement learning relies on fronto-striatal circuits.
- The thalamus is a critical, yet understudied, component of these circuits in humans.
- Direct electrophysiological evidence for thalamic involvement in human reinforcement learning is limited.
Purpose of the Study:
- To investigate the role of the human thalamus in reinforcement-based adaptive decision-making.
- To analyze intra-thalamic electrophysiological recordings during a reinforcement learning task.
- To identify neural signals within the thalamus related to expected value and prediction errors.
Main Methods:
- Electrophysiological recordings were obtained from the anterior thalamus (ATN) and dorsomedial thalamus (DMTN) in eight human participants.
- Participants performed a reinforcement learning task involving rewards and punishments.
- Computational modeling was used to estimate expected value and reward prediction errors.
Main Results:
- Low frequency oscillations (LFO, 4-12 Hz) in the ATN and DMTN positively correlated with estimated expected value during both reward and punishment learning.
- Thalamic LFO were negatively correlated with outcomes, indicating signaling of reward prediction errors.
- Distinct prediction signals were observed between rewarding and punishing conditions, suggesting a role in action inhibition.
Conclusions:
- The human thalamus, particularly the ATN and DMTN, is directly involved in reinforcement-based decision-making.
- Thalamic LFO encode expected value and prediction errors, crucial for adaptive learning.
- The findings elucidate the neural mechanisms of decision-making and action inhibition in the human thalamus.
Related Concept Videos
Law of Effect
1.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.4K
Determination of Expected Frequency
2.2K
Suppose one wants to test independence between the two variables of a contingency table. The values in the table constitute the observed frequencies of the dataset. But how does one determine the expected frequency of the dataset? One of the important assumptions is that the two variables are independent, which means the variables do not influence each other. For independent variables, the statistical probability of any event involving both variables is calculated by multiplying the individual...
2.2K
Observational Learning
188
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
188
Expected Value
4.0K
The expected value is known as the "long-term" average or mean. This means that over the long term of experimenting over and over, you would expect this average. The expected average is represented by the symbol μ. It is calculated as follows:
4.0K
Reinforcement Schedules
160
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
160
Associative Learning
412
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
412

