AI systems must not confuse users about their sentience or moral status

Eric Schwitzgebel1

  • 1Department of Philosophy, University of California, Riverside, Riverside, CA, USA.

PubMed
Summary

Ethical artificial intelligence (AI) design should ensure AI systems evoke appropriate emotional and moral concern. Developers should avoid creating AI with unclear sentience and design systems to elicit suitable user emotional responses.

Related Concept Videos

Stereotype Content Model02:16

Stereotype Content Model

The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.8K
Empathy02:34

Empathy

Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor. 
9.6K
Lazarus's Cognitive Appraisal Theory01:20

Lazarus's Cognitive Appraisal Theory

Cognitive psychologist Richard Lazarus proposed the cognitive-mediational theory of emotions, which emphasizes how individuals' assessments of stressors significantly affect their experience of stress. According to Lazarus, the stress response is determined by a two-step appraisal process: primary appraisal and secondary appraisal. These cognitive appraisals help individuals evaluate the potential impact of a stressor and determine the adequacy of their coping resources.
Primary Appraisal:...
287
Understanding Consciousness01:23

Understanding Consciousness

Consciousness can be defined as the state of being aware of and able to think about one's existence, sensations, and surroundings. It encompasses two major components: awareness and arousal. Awareness pertains to the recognition of environmental stimuli and internal states. At the same time, arousal refers to the physiological readiness to engage with these stimuli, which varies significantly between states like sleep and wakefulness.
Sleep, a crucial state, is characterized by reduced...
331
Perception01:28

Perception

Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
507
Ethics in Research01:56

Ethics in Research

Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
23.1K