Related Experiment Video
Updated: Jun 4, 2026

06:50
Marble Burying and Nestlet Shredding as Tests of Repetitive, Compulsive-like Behaviors in Mice
Published on: December 24, 2013
From reinforcement learning models to psychiatric and neurological disorders
Tiago V Maia1, Michael J Frank
1Department of Psychiatry, Columbia University, New York, New York, USA. tmaia@columbia.edu
Nature Neuroscience
|January 29, 2011
Summary
Reinforcement learning models enhance understanding of dopamine and cortico-basal ganglia-thalamo-cortical circuits. This approach offers insights into neurological disorders and aids in developing new treatments.
Area of Science:
- Computational neuroscience
- Neurobiology
- Psychiatry
Background:
- Reinforcement learning models have advanced the understanding of dopamine and cortico-basal ganglia-thalamo-cortical (CBGTC) circuits.
- These models are increasingly applied to psychiatric and neurological disorders linked to dopaminergic system and CBGTC circuit dysfunction.
Purpose of the Study:
- To review the application of reinforcement learning models in understanding brain function and disorders.
- To explore the use of these models in psychiatric and neurological conditions.
Main Methods:
- Review of existing literature on reinforcement learning models.
- Analysis of applications in Parkinson's disease, Tourette's syndrome, ADHD, addiction, and schizophrenia.
- Examination of preclinical animal models for drug screening.
Main Results:
- Reinforcement learning models provide sophisticated insights into dopamine and CBGTC circuits.
- The approach has demonstrated explanatory and predictive power for various disorders.
- Potential applications in developing novel therapeutic strategies are highlighted.
Conclusions:
- The integration of reinforcement learning models is crucial for advancing computational psychiatry and neurology.
- This approach holds significant promise for understanding and treating complex brain disorders.
- Continued growth in computational approaches is expected to yield further breakthroughs.
Related Concept Videos
Operant Conditioning Intervention
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
Modeling in Therapy
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in situations...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in situations...
Behavior Modification
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
A real-world application of operant conditioning principles is applied...
Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Real-World Application of Classical Conditioning
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...

