経験の再現は,非局所学習の効率と関連しています

Yunzhe Liu^1,2,3,4, Marcelo G Mattar⁵, Timothy E J Behrens^6,7

¹State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China. yunzhe.liu@bnu.edu.cn.

Science (New York, N.Y.)

|May 21, 2021

まとめ

神経の再生は時間と空間で隔てられた結果と行動を結びつけますこのバックワード・リプレイメカニズムは効率的な学習のための複雑なクレジット割り当て問題を解くのに役立ちます.

科学分野:

神経科学
認知科学
意思決定

背景:

効果的な意思決定には,行動と成果の間のつながりを理解する必要があります.
分離された行動と成果を結びつける神経的基盤は完全に理解されていません
過去の経験のニューラル再生はこれらのギャップを埋めるための仮説的なメカニズムです

研究の目的:

行動と結果が分離されている人間の非局所学習におけるニューラル・リプレイの役割を調査する.
行動と直接的な結果がどう結びついているかを調べるのです

主な方法:

直接的な価値学習と間接的な価値学習を区別するために,専門的なタスクを使用しました.
学習作業中に脳活動を記録するために磁気脳図 (MEG) を使った.
行動学習と相関する再生パターンのための神経活動の分析

主要な成果:

報酬を受け取った後の非ローカルな経験の有意な逆転が観察されました.
160ミリ秒の時差が確認されました
過去の経験の将来的な利益と相関していることがわかりました.

結論:

複雑なクレジット割り当て問題を解くための重要な神経メカニズムとして機能します.
このニューラル再生は行動値の効率的な学習を容易にし結果が即座に現れなくてもいいのです
ニューラル・リプレイは行動と結果の間の時間的・空間的な分離を橋渡しするという仮説を支持しています

さらに関連する動画

08:35

An Operant Intra-/Extra-dimensional Set-shift Task for Mice

Published on: January 22, 2016

12.4K

11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.5K

関連する概念動画

01:27

Associative Learning

788

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

788

01:12

Observational Learning

537

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

537

01:07

Elaborative Rehearsals

176

Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...

176

01:15

Real-World Application of Classical Conditioning

894

Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...

894

01:34

Woodward–Hoffmann Selection Rules and Microscopic Reversibility

3.4K

Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...

3.4K

01:25

Long-term Potentiation

3.0K

Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...