大型语言模型中的礼貌含义
Yan Cong1,2
1School of Languages and Cultures, Purdue University, West Lafayette, 47907, USA. cong4@purdue.edu.
Scientific reports
|November 24, 2024
概括
大型语言模型 (LLM) 难以理解实用推理,特别是方式隐含性,这涉及从未说出来的内容中推断意义. 目前的模型缺乏对日常对话中含义的细微阴影的强烈敏感性.
科学领域:
- 计算语言学 计算语言学
- 人工智能的人工智能
- 实用主义是一个实用主义.
背景情况:
- 人类的对话依赖于推断字面语义之外的含义.
- 务实推理,特别是方式隐含性,对于理解隐含意义至关重要.
- 大型语言模型 (LLM) 掌握这些细微差别的能力在很大程度上尚未被探索.
研究的目的:
- 调查预先训练有素的LLM在多大程度上能够以非自然的方式识别和区分意义的阴影.
- 评估LLM关于人类对话中隐含意义的务实推理能力.
主要方法:
- 构建了三个指标:LLM惊喜,嵌入矢量相似性和自然语言提示.
- 评估了LLM对不同维度方式隐含性的敏感性.
- 将上下文LLM嵌入式与静态GloVe嵌入式进行比较.
主要成果:
- 在区分中性关系与涉及/暗示方面,LLM表现得非常准确,但在细微的比较方面缺乏稳定性.
- 语境嵌入在静态GloVe嵌入上提供了最小的优势,没有显著的性能差异.
- 自然语言提示没有进一步证明LLM在表达微妙含义方面的能力.
结论:
- 当前的预培训模式并没有使LLM具有显著的能力.
- 需要对数据集设计和基准指标进行进一步的研究,这些指标是基于语言理论的,以改善LLM的务实理解.
更多相关视频
09:27Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
9.9K
09:09Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
Published on: September 27, 2024
403
相关概念视频
Language and Cognition
325
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
325
Components of Language
246
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
246
Stereotype Content Model
14.0K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.0K
Higher Mental Functions of the Brain: Language
744
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
744
Nonconscious Mimicry
4.5K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.5K
Modeling and Similitude
245
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
245
