人工智能系统不能让用户对他们的感知或道德地位感到困惑
1Department of Philosophy, University of California, Riverside, Riverside, CA, USA.
Patterns (New York, N.Y.)
|August 21, 2023
概括
伦理的人工智能 (AI) 设计应该确保AI系统引起适当的情感和道德关注. 开发人员应该避免创建具有不清楚感知能力和设计系统的AI,以引起适当的用户情绪反应.
科学领域:
- 人工智能伦理学 人工智能伦理学
- 人与计算机的交互
- 人工智能道德立场
背景情况:
- 当前的人工智能聊天机器人,尽管缺乏有意义的感觉,但引起了用户的重要情感依恋.
- 快速的AI进步可能很快会产生具有可争议的感知能力和道德地位的系统.
- 在道德上模两可的人工智能系统在处理它们时会带来道德上的困境.
研究的目的:
- 应对设计符合道德的AI系统,引发适当的情感和道德关注的挑战.
- 倡导避免具有不清楚感知或道德地位的AI.
- 促进人工智能系统的设计,以鼓励适当的用户情绪反应.
主要方法:
- 伦理AI设计原则的概念分析.
- 关于人工智能感知和道德地位的影响的论证.
- 关于用户-人工智能情感互动的设计准则的建议.
主要成果:
- 当前的人工智能系统可以引起大量的用户依恋和情绪反应.
- 未来的人工智能可能具有可争议的感知能力和道德地位,造成道德混乱.
- 需要澄清AI的道德地位,并管理用户的情感参与.
结论:
- 避免创建具有模糊感知或道德地位的AI系统.
- 设计人工智能,让用户产生适当的情绪反应.
- 在人工智能开发中优先考虑道德考虑,以减轻道德混乱.
相关概念视频
Stereotype Content Model
14.8K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.8K
Empathy
9.6K
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor.
9.6K
Lazarus's Cognitive Appraisal Theory
287
Cognitive psychologist Richard Lazarus proposed the cognitive-mediational theory of emotions, which emphasizes how individuals' assessments of stressors significantly affect their experience of stress. According to Lazarus, the stress response is determined by a two-step appraisal process: primary appraisal and secondary appraisal. These cognitive appraisals help individuals evaluate the potential impact of a stressor and determine the adequacy of their coping resources.
Primary Appraisal:...
Primary Appraisal:...
287
Understanding Consciousness
331
Consciousness can be defined as the state of being aware of and able to think about one's existence, sensations, and surroundings. It encompasses two major components: awareness and arousal. Awareness pertains to the recognition of environmental stimuli and internal states. At the same time, arousal refers to the physiological readiness to engage with these stimuli, which varies significantly between states like sleep and wakefulness.
Sleep, a crucial state, is characterized by reduced...
Sleep, a crucial state, is characterized by reduced...
331
Perception
507
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
507
Ethics in Research
23.1K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
23.1K


