Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Propagation of Action Potentials01:23

Propagation of Action Potentials

5.0K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
5.0K
Reinforcement Schedules01:24

Reinforcement Schedules

126
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
126
Associative Learning01:27

Associative Learning

276
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
276
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

93
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
93
Randomized Experiments01:13

Randomized Experiments

6.7K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
6.7K
Random Variables01:09

Random Variables

11.4K
A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
11.4K

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Modulation of the excitation/inhibition balance by astrocytes in a tripartite synapse model of Alzheimer's disease.

Neural regeneration research·2026
Same author

Chain-of-Detection: Enhancing Cross-Granularity Robotic Perception for Object Manipulation.

IEEE transactions on neural networks and learning systems·2025
Same author

Computational framework and tools for evaluating engineered channelrhodopsin performance in a degenerated retina.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same author

Optogenetic stimulation of inner retinal neurons restores retinal computations in a virtual degenerated human retina.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same author

Aberrant neural activity in the peritumoral cortex underlies the progression of tumor-associated seizures.

Nature communications·2025
Same author

Neuromorphic computing paradigms enhance robustness through spiking neural networks.

Nature communications·2025

相关实验视频

Updated: May 24, 2025

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions
07:34

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

Published on: March 25, 2014

9.8K

脑启发强化学习的尖变化政策梯度

Zhile Yang, Shangqi Guo, Ying Fang

    IEEE transactions on pattern analysis and machine intelligence
    |March 3, 2025
    PubMed
    概括

    我们介绍了SVPG (Spiking Variational Policy Gradient),这是一个由大脑功能启发的新型强化学习方法. SVPG弥合了奖励调制的峰值时间依赖可塑性 (R-STDP) 的差距,以提高性能和稳定性.

    科学领域:

    • 计算神经科学是一种神经科学.
    • 人工智能的人工智能
    • 机器学习 机器学习

    背景情况:

    • 强化学习 (RL) 越来越多地使用由大脑启发的模型用于神经形态硬件.
    • 奖励调制的尖峰时间依赖可塑性 (R-STDP) 是生物学上可行的和节能高效的,但面临着局部-全球学习规则差距.
    • 这种限制阻碍了R-STDP在复杂任务中的性能和广泛应用.

    研究的目的:

    • 开发一种新的R-STDP学习方法,以解决由本地-全球学习规则差异引起的性能限制.
    • 通过将当地可塑性规则与全球目标相结合,增强强化学习中神经网络的增强能力.
    • 提高人工智能中大脑启发的学习算法的稳定性和适用性.

    主要方法:

    • 设计了一个反复出现的获胜者占据全部的网络架构.
    • 提出了SVPG,一种新的R-STDP学习方法.
    • 从理论上来说,SVPG来自全球政策梯度,利用平均场推断来推断政策功能,以及为政策优化提供最后一步的近似计算.

    主要成果:

    • SVPG成功地解决了具有挑战性的任务,包括ViZDoom基于视觉的导航和现实的机器人控制.
    • 与现有的方法相比,SVPG的固有稳定性在输入变化,网络参数和环境干扰方面表现出卓越的优势.

    更多相关视频

    An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice
    08:59

    An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

    Published on: March 3, 2023

    1.9K
    Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
    11:18

    Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

    Published on: March 2, 2015

    10.2K

    相关实验视频

    Last Updated: May 24, 2025

    A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions
    07:34

    A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

    Published on: March 25, 2014

    9.8K
    An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice
    08:59

    An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

    Published on: March 3, 2023

    1.9K
    Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
    11:18

    Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

    Published on: March 2, 2015

    10.2K
  • 有效地弥合了当地R-STDP学习规则和全球学习目标之间的差距.
  • 结论:

    • 在生物学上可信的强化学习中,SVPG代表了重大进展,克服了传统R-STDP的关键局限性.
    • 拟议的方法显示出强大的潜力,用于神经形态计算和先进机器人的应用.
    • SVPG为大脑启发的人工智能提供了一个强大而有效的框架.