関連する実験動画
Updated: Sep 9, 2025

05:01
Evaluating Skilled Prehension in Mice Using an Auto-Trainer
Published on: September 12, 2019
5.8K
正確さはそれ自身の報酬である:自己誘導強化学習におけるエラーシグナルのブートストラップ
bioRxiv : the preprint server for biology
|September 2, 2025
まとめ
この研究では 単一の神経回路が 指導歌を暗記し ゼブラフィンチのパフォーマンスの質を 評価することを提案しています この予測的なキャンセルメカニズムは 外部報酬がなくても 自己学習を導くエラーシグナルを生成します
科学分野:
- 神経科学
- 計算神経科学
- 動物 の 行動
背景:
- 補強学習 (RL) は通常,スキルの獲得のための外部報酬機能を必要とします.
- ゼブラフィンチの歌を学ぶように 自律学習は 明確な外部の指導がないことで RLに挑戦します
- 曲の学習における内部生成されたパフォーマンス評価の 神経的基盤は不明である.
研究 の 目的:
- 教師による歌の記憶とパフォーマンス評価のための統合神経回路を提案し,モデル化する.
- 自己学習のためのエラーシグナルを生成する方法を調査する.
- これらのエラーシグナルが 補強学習エージェントを訓練できることを示すためです
主な方法:
- 曲の学習に関わる前脳の局所的な回路の計算モデルを開発した.
- シナプス可塑性による学習をシミュレートし,聴覚指導者の曲の入力を予測的にキャンセルすることに焦点を当てています.
- 学習過程を段階的にモデル化しました.
主要な成果:
- 学習回路は,パフォーマンス不一致をシグナルする集団エラーコードを生成します.
- 阻害性内ニューロンにおける反ヘッビアン可塑性は,実験データによって最もよく説明されている.
- モデル学習は2つの異なる段階で行われ,エラー感受性の鋭化と応答の最小化である.
- 生成されたエラー信号は,鳥の歌を複製する強化学習エージェントを成功裏に訓練しました.
結論:
- 予測的なキャンセルを用いた単一のニューラル回路は,曲の記憶とパフォーマンス評価の両方をサポートできます.
- ローカルな学習ルールは,自律的な行動学習のためのエラーシグナルを生成するのに十分です.
- このメカニズムは 動物が外部からの報酬なしに 複雑な行動を習得する方法の 潜在的説明を提供するものです
さらに関連する動画
08:51Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder
Published on: December 15, 2023
1.5K
11:18Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task
Published on: June 1, 2015
10.8K
関連する概念動画
Bootstrapping
670
The term "bootstrap" originated in the 19th century as a metaphor for self-improvement or achieving something independently, without external assistance. This concept extends to statistical bootstrapping, a self-contained method for estimating population parameters through resampling, even though it can be computationally intensive. Developed by the American statistician Dr. Bradley Efron in 1979, bootstrapping provides a robust way to perform inference when the original sample size is...
670
Avoidance Learning and Learned Helplessness
1.9K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.9K
Reinforcement
341
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
341
Observational Learning
310
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
310
Reinforcement Schedules
240
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
240
Rolling Resistance: Problem Solving
447
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
447