将认知任务集成到大模型的人工通用智能测试中
Youzhi Qu1, Chen Wei1, Penghui Du1
1Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen 518055, China.
iScience
|April 10, 2024
概括
这项研究提出了一个新的框架,用于评估使用认知科学启发的人工通用智能 (AGI) 测试的大型模型. 这些测试评估多维智能,旨在改善大型模型开发和社会融合.
科学领域:
- 人工智能的人工智能
- 认知科学 认知科学
- 计算心理学 计算心理学
背景情况:
- 目前的大型模型评估缺乏统一的框架来评估多维智能.
- 现有的方法依赖于特定任务的数据集,限制了综合能力评估.
- 大型模型的快速演变需要先进的评估方法.
研究的目的:
- 引入一个全面的框架来评估使用认知科学启发的人工通用智能 (AGI) 测试的大型模型.
- 通过提出一个多维情报评估来解决目前特定任务评估的局限性.
- 引导大型模型的有针对性的改进,并促进它们融入社会.
主要方法:
- 开发了一个包含结晶,流体,社会和体现智能测试的框架.
- 从人类智能评估中调整了精心设计的认知测试.
- 在沉浸式虚拟社区内进行综合测试,以模拟现实世界的互动.
主要成果:
- 提出了一个由认知科学原则启发的新型AGI测试框架.
- 倡导适应性测试复杂性与大型模型进步保持一致.
- 强调了准确的结果解释的重要性,以防止评估错误.
结论:
- 受认知科学启发的AGI测试提供了一种强大的方法来评估大模型智能.
- 这个框架可以指导大模型能力的具体改进.
- 拟议的方法将加速大型模型安全有效地融入人类社会.
相关概念视频
Intelligence
7.4K
The term "intelligence" is complex because it refers to both behavior and individuals, and its interpretation varies across cultures. European Americans tend to link intelligence with reasoning and cognitive skills, while in Kenya, it is tied to responsible participation in family and social life. In Uganda, intelligence is seen as the ability to know the right actions and carry them out effectively, while the Iatmul people of Papua New Guinea associate it with the capacity to remember...
7.4K
Introduction to Cognitive Psychology
479
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
479
Measures of Intelligence
7.2K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.2K
Triarchic Theory of Intelligence
7.9K
Robert Sternberg's triarchic theory of intelligence posits that intelligence is composed of three distinct but interrelated components: analytical, creative, and practical intelligence.
7.9K
Binet's Contribution to Measures of Intelligence
1.3K
Alfred Binet, along with his student Théophile Simon, was tasked by the French Ministry of Education in 1904 to create a method for identifying students who struggled to learn through conventional classroom instruction. This initiative aimed to address overcrowding by placing such students in specialized schools. Binet and Simon developed an intelligence test comprising 30 tasks, ranging from simple commands, like touching one's nose or ear, to more complex tasks, such as drawing...
1.3K
Wechsler's Contribution to Measures of Intelligence
1.5K
David Wechsler, a psychologist who worked with World War I veterans, developed a significant IQ test in 1939 called the Wechsler-Bellevue Intelligence Scale. This test was innovative because it combined several subtests that measured both verbal and nonverbal skills, reflecting Wechsler's belief that intelligence is a global capacity involving purposeful action, rational thinking, and effective interaction with the environment. This test later evolved into the Wechsler Adult Intelligence...
1.5K


