对于深度强化学习的一般竞争-合作行为者-关键框架
IEEE transactions on pattern analysis and machine intelligence
|February 16, 2026
概括
这项研究引入了一种新的双演员深度强化学习 (DRL) 方法,通过演员相互模仿来增强政策学习. 该方法提高了勘探和Q值的准确性,显著提高了各种DRL任务的性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 深度强化学习学习 (deep reinforcement learning) 是一种深度强化学习的方法.
背景情况:
- 深度强化学习 (DRL) 在探索和Q值估计方面面临挑战.
- 双重行为者DRL方法有希望,但缺乏行为者协作,导致低于最佳的政策.
研究的目的:
- 提出一种通用解决方案,以促进双重参与者DRL方法中的参与者之间的相互学习和协作.
- 通过解决参与者的独立性,提高DRL的政策制定和整体绩效.
主要方法:
- 引入了一种方法,以最大限度地减少行为者的行动输出差异,促进相互模仿.
- 整合最小化来自批评者的Q值差异,以确保模仿行为的一致价值估计.
- 开发了两个具体的实现,并将方法扩展到其他DRL方法.
主要成果:
- 拟议的方法显著增强了二十种最先进的 (SOTA) DRL方法,包括双重行为者的方法.
- 在11个不同的任务中观察到改善,通过回报和其他关键指标来衡量.
- 通过将该方法扩展到超出双作用子DRL之外,证明了更广泛的适用性.
结论:
- 拟议的相互学习框架有效地解决了双重参与者DRL中独立参与者的局限性.
- 这种方法通过改善政策优化和绩效,为DRL提供了显著的进步.
- 该方法的通用性和成功扩展到其他DRL范式表明了广泛的潜在影响.
相关概念视频
Reinforcement
969
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
969
Observational Learning
1.0K
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
1.0K
Actor-Observer Effect
421
The actor-observer effect, a cognitive bias closely linked to the fundamental attribution error, refers to the tendency for individuals to attribute their behavior to external, situational factors while explaining others’ behavior in terms of internal, dispositional traits. This asymmetry in attribution significantly influences social perception and judgment.Cognitive Mechanisms Behind the EffectTwo primary psychological mechanisms contribute to the actor-observer effect: differences in...
421
Reinforcement Schedules
538
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
538
The Two-State Receptor Model
3.1K
The two-state receptor model explains a drug's interaction with receptors, such as G protein-coupled receptors and ligand-gated ion channels, to induce or inhibit a biological response. When no natural ligands are present, a receptor exists in an equilibrium of inactive (Ri) and active (Ra) conformations. The inactive form does not produce a response, while the active form generates a basal effect known as constitutive activity.
The binding affinity of a drug determines its interaction with...
The binding affinity of a drug determines its interaction with...
3.1K
Cognitive Learning
1.4K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.4K
