手动模式的存在增加了人工智能错误的人类责任
Mads N Arnestad1, Samuel Meyers2, Kurt Gray3
1Department of Leadership and Organization, BI Norwegian Business School, Norway.
Cognition
|August 29, 2024
概括
人们更喜欢人工智能 (AI) 系统的手动控制,但有这种选择会增加人工智能错误时的人类责任. 这种"手动模式"的控制错觉带来了重大的社会成本.
科学领域:
- 人与计算机的互动.
- 认知心理学 认知心理学
- 人工智能伦理学 人工智能伦理学
背景情况:
- 现代社会越来越多地依赖人工智能 (AI) 来完成驾驶,投资和医疗等关键任务.
- 尽管人工智能的能力,人类表现出一种自然的愿望,保持对决策过程的最终控制.
- 人工智能系统中的"手动模式"概念反映了人类对覆盖选项的需求.
研究的目的:
- 调查在AI系统中提供手动模式的心理影响.
- 要确定手动控制的可用性是否会影响人工智能错误后的指责归因.
- 探索潜在的认知机制,如感知因果关系和反事实思维,调解这种效应.
主要方法:
- 进行了四项实验,以评估与手动模式和没有手动模式的人类偏好和与人工智能系统相关的归因.
- 参与者评估了涉及人工智能决策的场景,手动控制的可用性和成本有所不同.
- 统计分析了感知因果关系和反事实认知的调解作用.
主要成果:
- 参与者始终更喜欢提供手动模式的AI系统,即使它效率较低或成本更高.
- 仅仅存在手动模式就显著增加了当人工智能系统犯错时分配的人类责任的程度.
- 这种效应是由对因果关系的高度认知和对人类控制的反事实性思维的增加所调解的.
结论:
- 人类渴望通过人工智能系统的手动覆盖来实现虚幻的控制,这会带来意想不到的后果,主要是增加人工智能失败的人类责任.
- 了解这些心理偏见对于设计负责任的人工智能和管理社会期望至关重要.
- 这些发现突出了人类心理学和自主技术的整合之间的复杂相互作用.
相关概念视频
Stereotype Content Model
14.0K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.0K
Fundamental Attribution Error
12.8K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
12.8K
Decision Making
101
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
101
High-Level and Low-Level Awareness
254
Controlled processes in human consciousness represent high-alert mental states where individuals deliberately focus their attention on achieving specific goals. Controlled processes can be seen in situations like mastering new technology, where a person might become so absorbed that they ignore surrounding distractions. Such processes involve selective attention, requiring one to concentrate on particular elements of experience while disregarding others. These are governed by executive...
254
Reason and Intuition
6.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.4K
Introduction to Cognitive Psychology
453
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
453


