对外部反的厌恶足以确保代理调整
1International School of Engineering, Chulalongkorn University, Bangkok, Thailand. paulo.g@chula.ac.th.
Scientific reports
|September 10, 2024
概括
担心的代理人,一种新的AI架构,通过预测负面反,与人类价值观保持一致. 这种方法改善了人工智能对齐,即使增加了智能,与传统方法不同.
科学领域:
- 人工智能的人工智能
- 人工智能调整对齐
- 机器伦理 机器伦理
背景情况:
- 人工智能调整挑战旨在确保人工智能 (AI) 系统按照人类价值观运行.
- 理性代理人最大限度地发挥实用功能可能与人类价值观有所不同,特别是在更高的智能水平.
- 单一的实用函数是不够的; 整体的对齐方法是必要的.
研究的目的:
- 引入和评估一种新型的人工智能代理架构,称之为"令人震惊的代理".
- 展示这些代理人如何在没有外部反的情况下更好地与人类价值观保持一致.
- 为了表明这种对齐随着代理情报的增加而得到改善.
主要方法:
- 具有有效的实用功能的架构代理,结合设计师定义的部分实用性和对负面反的期望.
- 实施时间推理,以在环境演变下接近设计者的意图.
- 在模拟环境中评估可怕物质,旨在揭示错位机会.
主要成果:
- 与模拟环境中的基线药物相比,感应剂显示出更高的对齐性.
- 随着他们的情报增加,恐惧特工的对齐性得到了改善.
- 这一战略在不需要直接的外部反的情况下实现了对齐.
结论:
- 惊的代理提供了一个有前途的解决方案,对AI对齐挑战.
- 通过内部推理预测负面反是增强人工智能调整的可行机制.
- 拟议的架构显示了强大的AI对齐作为智能尺度的潜力.
相关概念视频
Self-Evaluation: Self-Enhancement and Self-Verification
5.2K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.2K
Stereotype Threat and Self-fulfilling Prophecies
37.5K
When we hold a stereotype about a person, we have expectations that he or she will fulfill that stereotype. A self-fulfilling prophecy is an expectation held by a person that alters his or her behavior in a way that tends to make it true. When we hold stereotypes about a person, we tend to treat the person according to our expectations. This treatment can influence the person to act according to our stereotypic expectations, thus confirming our stereotypic beliefs. Research by Rosenthal and...
37.5K
Confirmation Biases
5.5K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.5K
Fundamental Attribution Error
12.8K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
12.8K
In- and Out-Groups
39.0K
People all belong to a gender, race, age, and social economic group. These groups provide a powerful source of our identity and self-esteem (Tajfel & Turner, 1979) and serve as our in-groups. An in-group is a group that we identify with or see ourselves as belonging to.
39.0K
Cognitive Dissonance
32.5K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
32.5K


