拥有多个自我有助于学习代理人探索和适应复杂的不断变化的世界
Zack Dulberg1, Rachit Dubey2, Isabel M Berwian1
1Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544.
概括
用专门的子剂设计的模块化剂,在动态环境中优秀地平衡多个相互冲突的需求. 这种架构促进了内在的探索和强大的适应,优于传统的综合方法.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 系统生物学 系统生物学
背景情况:
- 适应性代理人面临着在不断变化的环境中满足多样化,相互矛盾的需求的挑战.
- 传统的单体药物将多个目标整合到一个单一的成功指标中.
- 了解病原体适应原理可以揭示生物系统,包括人类的认知.
研究的目的:
- 调查模块化剂设计的有效性,以满足多个相互冲突的需求.
- 在多目标任务中,将模块化剂与单质剂的性能进行比较.
- 探索有助于模块化代理的稳定性和可扩展性的潜在机制.
主要方法:
- 利用深度强化学习形式主义用于代理设计和模拟.
- 开发了一项生物相关的多目标任务,重点是维持生理恒常.
- 在各种非静止环境中模拟模块化代理和单体代理.
主要成果:
- 模块化代理证明了新兴的,内在的探索,与外部强加的方法不同.
- 模块化剂在适应不断变化的非静止环境方面表现出卓越的稳定性.
- 代理商的性能有效地扩展,随着越来越多的冲突目标的增加.
结论:
- 模块化代理架构提高了满足多个相互冲突需求的能力.
- 模块化代理的内在探索和高效表示有助于稳定性和可扩展性.
- 这些发现表明,模块化是复杂系统适应的潜在规范原则,可能解释人类的"多个自我".
相关概念视频
The Sense of Self: Reflected Self-Appraisal and Social Comparison
50.1K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
50.1K
Self-Schemas
31.2K
In general, a schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.
31.2K
Self-Evaluation: Self-Enhancement and Self-Verification
5.2K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.2K
Social Cognitive Perspective on Personality
583
Social cognitive perspectives on personality emphasize the importance of conscious awareness, beliefs, expectations, and goals in shaping behavior. These perspectives incorporate behaviorist principles, such as learning through reinforcement and conditioning, but extend beyond them by highlighting human reasoning and planning. Unlike traditional behaviorist views, social cognitive theory focuses on how individuals reflect on their past experiences and plan for future outcomes by considering...
583
Purposive Learning
146
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
146
Nonconscious Mimicry
4.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.6K


