人工智能培训对人类决策的后果
Lauren S Treiman1, Chien-Ju Ho1,2, Wouter Kool1,3
1Division of Computational & Data Sciences, Washington University in St. Louis, St. Louis, MO 63130.
概括
人们故意改变他们的行为来训练人工智能 (AI) 模型,创造习惯,可以延续偏见. 这种意想不到的后果挑战了AI.
科学领域:
- 行为科学 行为科学
- 人工智能伦理学 人工智能伦理学
- 人与计算机的交互
背景情况:
- 人工智能 (AI) 模型经常从人类行为中学习,假设这些训练数据是公正的.
- 这个假设至关重要,因为人工智能越来越多地影响日常决策.
研究的目的:
- 调查人类是否有意修改他们的行为,当他们意识到他们的行为被用来训练AI时.
- 为了确定这些行为变化是否会在AI培训阶段结束后继续存在.
主要方法:
- 使用最后通游戏进行了五项研究,参与者决定由人类或人工智能提出的货币分割.
- 参与者有时被告知他们的选择将培养人工智能提议者,而其他人则没有.
- 通过让参与者在没有人工智能培训激励的情况下重复任务来评估行为持续性.
主要成果:
- 参与者修改了他们的行为,以训练人工智能提出公平的建议,即使没有直接的个人利益.
- 即使参与者被告知他们的反应将不再用于人工智能训练,这种行为转变仍然存在,这表明习惯形成.
- 这些发现表明,人类行为作为训练数据可以导致人工智能延续偏见,人类形成非习惯性行为.
结论:
- 用于人工智能培训的人类行为并不是无偏见的,因为人们适应他们的行为来塑造人工智能.
- 旨在公正地代表人类偏好的人工智能算法由于这种行为适应而面临挑战.
- 该研究强调了在培训过程中需要考虑人类和人工智能之间的相互影响.
更多相关视频
05:48The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients
Published on: June 12, 2020
5.7K
07:05Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
Published on: September 10, 2018
6.0K
相关概念视频
Decision Making
101
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
101
Reason and Intuition
6.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.4K
Timing and Consequences on Behavior
87
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
87
Introduction to Cognitive Psychology
453
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
453
Cause and Effect
10.9K
While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
10.9K
The Availability Heuristic
5.9K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
5.9K
