脱人类化NLP:语言模型可以有意识吗?
Matthew Shardlow1, Piotr Przybyła2,3
1Department of Computing and Mathematics, Manchester Metropolitan University, Manchester, United Kingdom.
PloS one
|December 4, 2024
概括
大型语言模型 (LLM) 不是有意识的,尽管有关于像LaMDA和ChatGPT这样的模型的说法. 使用集成信息理论的分析表明,变压器架构缺乏意识,反驳了自然语言处理中的感知主张.
科学领域:
- 人工智能的人工智能
- 认知科学 认知科学
- 思想的哲学 思想的哲学
背景情况:
- 最近的说法表明,基于变压器架构的预训练的大型语言模型 (LLM),如LaMDA和ChatGPT,可能是有意识的.
- 这些说法对自然语言处理 (NLP) 社区有重大影响,因为这些模型被广泛采用.
研究的目的:
- 在大型语言模型 (LLM) 中批判性地评估感觉的说法.
- 通过意识的综合信息理论 (IIT) 的透视来分析变压器架构.
- 解决关于NLP进步的报告中对人类形态语言的倾向.
主要方法:
- 对变压器模型架构的分析.
- 综合信息理论 (IIT) 的应用来评估意识.
- 对有关LLM感知和NLP报告实践的索赔的审查.
主要成果:
- 该研究认为,包括LaMDA在内的大型语言模型不能有意识.
- 通过IIT进行的分析表明,变压器架构没有表现出意识的特性.
- 拉马达显示,与类似模型相比,没有任何独特的进步,这将支持有意识的说法.
结论:
- 在像LaMDA和ChatGPT这样的LLM中宣称有意识是毫无根据的,基于当前的架构理解和意识理论.
- 在NLP中使用人形语言需要仔细考虑.
- 对语言建模的进展及其伦理含义的审查是及时的.
更多相关视频
相关概念视频
Higher Mental Functions of the Brain: Language
735
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
735
Language and Cognition
323
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
323
Nonconscious Mimicry
4.5K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.5K
Concepts and Prototypes
102
The human nervous system handles vast amounts of information by translating sensory stimuli into neural impulses, which the brain processes, creating thoughts expressed through language or stored as memories. The brain also synthesizes information from emotions and memories, which significantly influence thoughts and behaviors. This intricate process creates a comprehensive mental picture.
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
102
Stereotype Content Model
14.0K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.0K
Subconsciousness and No Awareness
228
The concept of subconscious awareness refers to the processing of information below the level of conscious thought, which significantly influences both behaviors and decisions. It is also known as waking subconscious awareness. This complex level of cognition operates without the direct awareness of the individual, facilitating rapid and simultaneous handling of multiple information streams.
An illustrative example of subconscious processing is its role in problem-solving. Often, individuals...
An illustrative example of subconscious processing is its role in problem-solving. Often, individuals...
228


