发现最先进的强化学习算法
Junhyuk Oh1, Greg Farquhar2, Iurii Kemaev2
1Google DeepMind, London, UK. junhyuk@google.com.
Nature
|October 22, 2025
概括
机器现在可以发现高级强化学习 (RL) 规则, 人工智能的这一突破是通过从代理体验中学习而实现的.
科学领域:
- 人工智能
- 机器学习
- 强化学习
背景情况:
- 生物系统利用进化的强化学习 (RL) 机制.
- 目前的人工智能依赖于手工设计的学习规则.
- 发现自主RL算法一直是一个长期的挑战.
研究的目的:
- 证明机器可以自主发现最先进的强化学习规则.
- 通过meta-learning开发一种发现RL规则的方法.
主要方法:
- 从代理人群的集体体验中进行超级学习.
- 在各种复杂的环境中培训代理人.
- 发现有关政策和预测更新的具体RL规则.
主要成果:
- 发现的RL规则表现优于阿塔里基准的所有现有规则.
- 发现的规则超越了先进的RL算法在未见的挑战性基准.
- 这代表了强化学习算法的重大进步.
结论:
- 机器可以自主发现强化学习算法.
- 未来的人工智能可能依赖于自动发现的RL算法.
- 这种方法从手动设计转向经验驱动的AI学习规则的发现.
相关概念视频
Reinforcement
826
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
826
Reinforcement Schedules
453
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
453
Observational Learning
824
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
824
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Law of Effect
2.5K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
2.5K
Avoidance Learning and Learned Helplessness
2.5K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.5K
