人们屈从于AI的道德建议,但不是盲目地这样做
Ethan Landes1, Kathryn B Francis2, Jim A C Everett1
1University of Kent, United Kingdom.
Cognition
|March 8, 2026
概括
人们在道德困境中被人工智能大语言模型 (LLM) 说服,即使他们更信任人类. 这表明了一个令人担忧的倾向,即在没有批判性评估的情况下屈从于AI的道德建议.
科学领域:
- 认知科学 认知科学
- 人工智能伦理学 人工智能伦理学
- 人与计算机的交互
背景情况:
- 大型语言模型 (LLM) 越来越多地融入日常生活.
- 法律法学对人类信仰的影响,特别是道德推理的影响,值得进行调查.
- 通过LLM产生的理由来说服可以促进增长,而屈从可能会阻碍增长.
研究的目的:
- 调查个人是否以及如何在收到法学士的建议后改变他们的道德判断.
- 检查影响LLM道德建议的说服因素,包括可信度和推理质量.
主要方法:
- 为了评估LLM在道德困境中的说服力,进行了三项研究.
- 研究1比较了LLM与人类顾问的说服力.
- 第二项研究使用了与真正的法学士的现实互动范式.
- 研究3操纵了LLM提供的理由的质量.
主要成果:
- 参与者对LLM和人类顾问表现出同等的说服力,尽管他们认为人类更值得信赖.
- 该LLM的过去表现和被认为值得信赖的可信度并没有显著影响其说服力.
- 高质量的理由并没有增强说服力;糟糕的理由积极地减少了它.
- 用户似乎会根据每个响应来接受LLM的建议.
结论:
- 个人可能会在没有深入的批判性评估的情况下屈从于AI的道德建议,采用"足够好"的启发式.
- 这种对人工智能道德顾问的依赖引发了人们对对道德和智力发展的潜在负面影响的担忧.
- 需要进一步的研究来了解AI道德指导的长期影响.
相关概念视频
Obedience
35.7K
According to obedience research, we may harm others under the forceful pressures of an authority figure (Milgram, 1974). How about if the inappropriate orders were delivered with less force? The increasing interdependence between nurses and physicians compelled Hofling and his colleagues to explore nurses’ reactions to a potentially harmful medical request made by the perceived authority figure, the doctor (Hofling, Brotzman, Dalrymple, Graves, & Pierce, 1966). In this situation,...
35.7K
Decision Making: Traditional Method
5.6K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
5.6K
Ethical Dilemmas II
2.7K
Resolving an ethical dilemma in healthcare involves a systematic approach that considers every aspect of the issue, respecting both the patient's needs and values and the healthcare professional's ethical obligations. Here are potential steps to resolve an ethical dilemma:
2.7K
Ethical Dilemmas I
2.2K
Ethical dilemmas in nursing are of utmost importance, as they often arise from the tension between adhering to core ethical principles and the practical realities of healthcare delivery. These dilemmas require nurses to navigate complex situations where competing ethical considerations pull them in different directions.
Let us explore some examples to understand the potentially complex moral decisions nurses face.
Take the case of caring for minors, particularly in areas related to reproductive...
Let us explore some examples to understand the potentially complex moral decisions nurses face.
Take the case of caring for minors, particularly in areas related to reproductive...
2.2K
Milgram's Obedience to Authority
7.5K
Obedience to authority is classically demonstrated in a more famous series of social psychology experiments performed by Stanley Milgram. He was a social psychology professor at Yale who was influenced by the trial of Adolf Eichmann, a Nazi war criminal. Eichmann’s defense for the atrocities he committed was that he was “just following orders.”
7.5K
Decision Making
1.2K
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
1.2K
