Memory consolidation from a reinforcement learning perspective

Area of Science:

• Neuroscience
• Cognitive Science
• Computational Neuroscience

Background:

• Memory consolidation converts short-term memories into long-term ones.
• The hippocampus, particularly CA3 and CA1 regions, is vital for memory, imagination, future planning, and valuation.
• CA3 generates novel activity patterns, while CA1 evaluates and reinforces them for reward maximization.

Purpose of the Study:

• To propose a novel framework for memory consolidation.
• To link hippocampal function to reinforcement learning principles.
• To reframe memory consolidation as a simulation-based optimization process.

Main Methods:

• Literature review and synthesis of existing findings on hippocampal function and memory consolidation.
• Conceptual modeling linking hippocampal subregions (CA3, CA1) to reinforcement learning (Dyna algorithm).
• Theoretical framework development based on neurobiological evidence and computational algorithms.

Main Results:

• The CA3 region generates diverse neural activity patterns.
• The CA1 region evaluates and reinforces patterns that maximize rewards.
• Memory consolidation can be conceptualized as offline reinforcement learning.

Conclusions:

• Memory consolidation may be an offline reinforcement learning process.
• This framework enhances understanding of adaptive decision-making.
• Hippocampal function in memory is analogous to simulation-based learning in artificial agents.