人与机器智能:通过复杂系统理论评估自然语言生成模型
IEEE transactions on pattern analysis and machine intelligence
|January 24, 2024
概括
这项研究比较了GPT-2的文本,人类小说和使用复杂性科学的代码. 在 GPT-2 中使用.
科学领域:
- 复杂性科学 复杂性科学
- 自然语言生成 (NLG) 是指自然语言的生成.
- 计算语言学 计算语言学
背景情况:
- 像GPT-2这样的变压器架构在自然语言生成 (NLG) 中表现出色,产生类似人类的文本.
- 了解这些深度学习模型的基础信息处理仍然是一个挑战.
- 目前正在探索分析文本复杂性的现有方法,以区分机器生成的内容.
研究的目的:
- 在GPT-2生成的文本中对随机过程进行比较分析,人类小说和编程代码.
- 为了研究机器学习应用程序的复杂性测量所产生的文本嵌入能力.
- 增强基于深度学习的NLG系统的理论理解.
主要方法:
- 多分形确定波动分析 (MF-DFA) 和反复量化分析 (RQA).
- 应用Zipf定律和近似来描述文本属性.
- 使用机器学习的进化技术开发合成文本描述符和特征选择.
主要成果:
- 与人类小说和代码相比,GPT-2生成的文本表现出明显的长距离相关性和复发模式.
- 多变量分析显示GPT-2文本位于自然语言和计算机代码之间.
- 使用复杂性衍生特征对文本类型进行分类的高准确度表明它们的信息性.
结论:
- 复杂度指标为NLG输出的统计属性提供了有价值的见解.
- 拟议的方法可以改善文本分类,假新闻检测和抄袭检测系统.
- 这项研究有助于理解NLG深度学习模型的"黑子"性质.
相关概念视频
Triarchic Theory of Intelligence
7.9K
Robert Sternberg's triarchic theory of intelligence posits that intelligence is composed of three distinct but interrelated components: analytical, creative, and practical intelligence.
7.9K
Introduction to Cognitive Psychology
484
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
484
Intelligence
7.4K
The term "intelligence" is complex because it refers to both behavior and individuals, and its interpretation varies across cultures. European Americans tend to link intelligence with reasoning and cognitive skills, while in Kenya, it is tied to responsible participation in family and social life. In Uganda, intelligence is seen as the ability to know the right actions and carry them out effectively, while the Iatmul people of Papua New Guinea associate it with the capacity to remember...
7.4K
Biological Influences on Intelligence
106
Intelligence is often thought to be linked to brain size, but the relationship is more complex than that. While brain size does correlate modestly with some abilities, like verbal skills, the connection is weaker for others, such as spatial reasoning. Other factors, like brain structure, also play crucial roles. For instance, despite Einstein's smaller-than-average brain, his parietal cortex, which is involved in spatial reasoning, was 15% wider, suggesting that neural density might matter...
106
Multiple Intelligences Theory
7.5K
Howard Gardner's theory of Multiple Intelligence proposes that there are nine distinct types of intelligence, each reflecting different ways of interacting with the world. Introduced in 1983 and expanded in subsequent years, Gardner's framework challenges the traditional notion of a single, generalized intelligence.
7.5K
Cattell's Theory of Intelligence
6.5K
Raymond Cattell, along with John Horn, made significant contributions to our understanding of intelligence by distinguishing between two types: fluid intelligence and crystallized intelligence.
Fluid intelligence involves the capacity to solve new problems and adapt to unfamiliar situations. It's the type of intelligence individuals use when they encounter a novel problem or puzzle that requires innovative thinking. For instance, figuring out how to operate a new gadget relies heavily on...
Fluid intelligence involves the capacity to solve new problems and adapt to unfamiliar situations. It's the type of intelligence individuals use when they encounter a novel problem or puzzle that requires innovative thinking. For instance, figuring out how to operate a new gadget relies heavily on...
6.5K


