在大型语言模型中分析信息突出性的行为分析
Jan Trienes1, Jörg Schlötterer1,2, Junyi Jessy Li3
1Marburg University.
概括
大型语言模型 (LLM) 在总结过程中表现出对信息突出性的一致,层次化的理解. 然而,这种内在的突出性在内观上是不可获得的,并且与人类的判断力只有微弱的结合.
科学领域:
- 人工智能的人工智能
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
背景情况:
- 大型语言模型 (LLM) 证明了对文本总结的熟练程度,这种能力取决于辨别内容的重要性.
- 通过LLM内部化"突出"的精确性质仍然是一个开放的研究问题.
- 了解LLM的突出性对于解释他们在内容选择中的决策过程至关重要.
研究的目的:
- 开发一个可解释的框架来导出和调查在LLMs的信息突出性.
- 系统地分析LLM在总结任务中如何优先考虑信息.
- 为了比较LLM衍生的突出与人类的感知.
主要方法:
- 引入了一个可解释的框架来探讨LLM总结行为.
- 用长度控制的总结作为一种行为实验.
- 使用"正在讨论中的问题"的追踪来得出一个突出代理.
- 在13个不同的LLM和四个不同的数据集进行了实验.
主要成果:
- 法学士对信息突出性有着微妙而层次化的理解.
- 发现突出模式在不同的LLM家族和大小中普遍一致.
- 在信息优先级方面,LLM行为表现出高度的一致性.
- 由此衍生的突出性概念是无法通过模型内观获得的.
- 士学位的突出性与人类对信息重要性判断的相关性仅为微弱.
结论:
- 法律学将信息突出性的结构化,层次化的概念内化.
- 尽管内部模式一致,但LLM的突出性并不能直接解释或与人类直觉保持一致.
- 需要进一步的研究来弥合LLM突出性和人类理解之间的差距.
相关概念视频
Language and Cognition
704
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
704
Automatic Processing and Automatic Social Behavior
210
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
210
Behaviorism
4.3K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
4.3K
Higher Mental Functions of the Brain: Language
3.4K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.4K
Lateralization
960
Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
960
Components of Language
746
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
746

