学习的判断区分了人类与大型语言模型在预测记忆中的区别
Markus Huff1,2, Elanur Ulakci3,4
1Perception and Action Lab, Leibniz-Institut Für Wissensmedien, Schleichstr. 6, 72072, Tübingen, Germany. markus.huff@uni-tuebingen.de.
Scientific reports
|October 7, 2025
概括
大型语言模型 (LLM) 不像人类那样准确地预测记忆性能. 这项研究表明,LLM与元认知斗争,突出了他们对人工智能应用的自我监控能力的差距.
科学领域:
- 认知科学 认知科学
- 人工智能的人工智能
- 心理学 心理学 心理学
背景情况:
- 大型语言模型 (LLM) 在语言任务中展示了类似人类的认知能力.
- 超认知,特别是预测自己记忆表现的能力 (学习判断 - JOL),对于有效的学习和自我调节至关重要.
- 在LLMs的元认知能力,特别是他们的JOL准确性,仍然在很大程度上未被探索.
研究的目的:
- 评估当前的LLM (基于ChatGPT) 是否可以准确地预测他们自己的记忆性能,反映人类学习判断 (JOL).
- 调查如何环境适应影响人类和LLMJOL在处理具有挑战性的花园路径句子时.
主要方法:
- 使用跨代理预测模型将人类JOL与LLM JOL进行比较.
- 参与者 (人类和LLM) 被测试了对句子对的记忆回忆,包括花园路径句子.
- 操作了上下文合适 (合适与不合适),以检查其对JOL准确性的影响.
主要成果:
- 人类JOL可靠地预测了实际的记忆性能.
- 没有一个测试的LLM (GPT-3.5-turbo,GPT-4-turbo,GPT-4o) 显示出对记忆性能的准确预测能力.
- 即使在适当的背景下呈现句子时,LLM JOL的准确性也没有得到改善.
结论:
- 在对象级的认知任务中,LLM表现出色,但缺乏元级的自我监测,无法准确地预测记忆性能.
- 这种在LLM的元认知缺陷需要进一步的研究和开发,以提高他们的自我意识.
- 提高LLM的元认知能力对于其有效地融入教育工具和人类-人工智能协作系统至关重要.
更多相关视频
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
8.0K
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
1.0K
相关概念视频
01:27Language and Cognition
711
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
711
01:10Higher Mental Functions of the Brain: Language
3.4K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.4K
01:26Higher Mental Functions of Brain: Learning and Memory
1.9K
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
1.9K
01:18Long-Term Memory
648
Long-term memory is a relatively permanent type of memory, capable of storing vast amounts of information over extended periods. Its storage capacity is generally considered unlimited.
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
648
01:27Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
01:21Cognitive Learning
1.0K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.0K