相关实验视频
Updated: Jan 10, 2026

08:00
Decoding Natural Behavior from Neuroethological Embedding
Published on: October 3, 2025
569
TBC-HRL:一种生物灵感的框架,用于稳定和可解释的等级强化学习
Zepei Li1, Yuhan Shan2, Hongwei Mo1
1College of Intelligent Systems Science and Engineering, Harbin Engineering University, No.145 Nantong Street, Harbin 150001, China.
Biomimetics (Basel, Switzerland)
|November 26, 2025
概括
定时和生物电路等级增强学习 (TBC-HRL) 通过使用定时子目标和生物启发的神经网络来提高代理性能. 这种以生物为灵感的方法提高了复杂任务的稳定性,精度和适应性.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 机器人技术 机器人技术 机器人技术
背景情况:
- 层次增强学习 (HRL) 有效地分解复杂的任务,但面临诸如层次间的不稳定性和糟糕的解释性等挑战.
- 在现实世界中,HRL的应用受到诸如低效的次目标调度和延迟响应等问题的阻碍.
研究的目的:
- 引入定时和生物电路等级增强学习 (TBC-HRL),这是一个解决HRL局限性的新框架.
- 增强强化学习代理的协调,一致性和时间依赖模型.
主要方法:
- 实施了一个定时的次目标调度策略,具有固定的执行持续时间 (τ),以模仿节奏性的生物行动模式.
- 引入了一个神经动态生物电路网络 (NDBCNet),灵感来自C. elegans,用于低级控制,具有稀疏的连接和连续时间动态.
主要成果:
- 在6个复杂的模拟任务中,TBC-HRL表现出更好的政策稳定性和行动精度.
- 与传统网络相比,NDBCNet组件提供了增强的解释性和减少的计算开销.
- 实验证实了TBC-HRL在动态环境中的卓越适应性.
结论:
- 生物启发的机制,如定时调度和生物电路,显著提升HRL能力.
- TBC-HRL为智能控制系统提供了一种实用且潜在的变革性方法,特别是在资源有限的平台上.
相关概念视频
Observational Learning
802
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
802
Reinforcement
797
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
797
Reinforcement Schedules
438
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
438
Avoidance Learning and Learned Helplessness
2.5K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.5K
Hierarchy of Motor Control
5.9K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
5.9K
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
