梅纳德·史密斯 (Maynard Smith) 再次回顾:多因素强化学习方法对信号行为的共同进化
Olivia Macmillan-Scott1, Mirco Musolesi1,2
1AI Centre, Department of Computer Science, University College London, London, United Kingdom.
PLoS computational biology
|August 26, 2025
概括
多代理强化学习 (MARL) 挑战了菲利普·西德尼爵士的游戏模式, 这项研究发现,代理人经常发展积极的亲社会性,绕过信号的需要以获得最佳结果.
科学领域:
- 进化生物学
- 人工智能
- 动物行为
背景情况:
- 信号共进化是动物行为和人工代理通信的一个关键问题.
- 菲利普·西德尼爵士的游戏是为了模拟二元交互和诚实信号的出现而开发的.
研究的目的:
- 通过多代理强化学习 (MARL) 调查信号共进化.
- 分析菲利普·西德尼爵士游戏中的新兴行为,
- 确定有利于诚实的信号与其他交互策略的条件.
主要方法:
- 多代理强化学习 (MARL) 应用于菲利普·西德尼爵士的游戏.
- 分析新出现的代理行为和战略空间.
- 研究学习和折扣率对代理奖励最大化的影响.
主要成果:
- 在大多数情况下,MARL模拟与原始模型的预测偏离.
- 代理人经常采取主动的亲社会行为,在没有明确的信号的情况下交换资源.
- 通过高学习率和低折扣率来实现最大化回报的最佳结果.
结论:
- 菲利普·西德尼爵士的游戏本身并不鼓励诚实的信号.
- 马尔是研究进化动态和新兴行为的强大,可解释的工具.
- 在许多模拟场景中,积极的社会化而不是诚实的信号是最佳策略.
相关概念视频
Reinforcement
341
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
341
Observational Learning
311
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
311
Interactions Between Signaling Pathways
6.4K
Signaling cascades usually lack linearity. Multiple pathways interact and regulate one another, allowing cells to integrate and respond to diverse environmental stimuli.
Convergence and divergence, and cross-talk between signaling pathways
Two distinct signaling pathways can converge on a single functional unit, which may either be a single protein or a complex of proteins. The response is either functionally distinct or synergistic between the two pathways but different from the response...
Convergence and divergence, and cross-talk between signaling pathways
Two distinct signaling pathways can converge on a single functional unit, which may either be a single protein or a complex of proteins. The response is either functionally distinct or synergistic between the two pathways but different from the response...
6.4K
Reinforcement Schedules
241
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
241
Autocrine Signaling
48.6K
Autocrine signaling is one of the many signaling mechanisms that function inside multicellular organisms to carry out intercellular communication. In this type of signaling mechanism, the same cell that secretes an extracellular signaling molecule also expresses the receptors to bind and respond to that signaling molecule.
Autocrine Signaling in Macrophages
Under normal physiological conditions, autocrine signaling is essential for maintaining homeostasis. This process is well characterized in...
Autocrine Signaling in Macrophages
Under normal physiological conditions, autocrine signaling is essential for maintaining homeostasis. This process is well characterized in...
48.6K
Evolutionary Psychology
409
Evolutionary psychology explores the origins of human behavior and mental processes by framing them within the context of natural selection, a theory famously propounded by Charles Darwin. This field asserts that many behaviors common across human societies — ranging from instinctive fear reactions to complex social interactions — arose as evolutionary adaptations. These adaptations enhanced the survival and reproductive success of our ancestors, thereby becoming embedded in the...
409


