利用大型语言模型和嵌入式表示来进行增强的词相似性计算.
XiaoHong Peng1, Hongbin Jiang1, Jing Chen2
1College of Mathematics and Computer Science, Guangdong Ocean University, Zhanjiang, 524088, China.
Scientific reports
|December 8, 2025
概括
本研究介绍了WSLE,这是计算单词相似性的新框架. WSLE增强了来自大型语言模型 (LLM) 的语义表示,以更准确地测量单词相似性.
科学领域:
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
- 人工智能的人工智能
背景情况:
- 当前的单词相似性方法与精细的语义和上下文扎.
- 生成语义表示经常表现出偏见 (例如,部分语音) 和冗余性,影响准确性.
研究的目的:
- 提出WSLE,这是一个整合大型语言模型 (LLM) 与矢量嵌入的框架,用于改进单词相似性计算.
- 解决基于LLM的语义表示生成的挑战,包括偏见和冗余性.
主要方法:
- WSLE对词汇项目,语法类别,语义描述和提示长度施加约束,以完善LLM语义生成.
- 生成的语义表示被转换成高维向量嵌入使用深度语义嵌入模块.
- 评估使用基准数据集上的Pearson (r) 和Spearman (ρ) 相对应系数.
主要成果:
- 在LLM生成的表示中,WSLE有效地减轻了部分语音偏差,语义模糊性和信息冗余.
- 与RG65,MC30,YP130和MED38数据集的现有方法相比,该框架显示出更高的性能.
- 对于单词相似度测量,WSLE在准确性和稳定性方面取得了显著的优势.
结论:
- 通过增强LLM语义表示,WSLE提供了对单词相似性计算的强大而准确的方法.
- 提出的方法克服了传统技术的局限性,为更精确的语义分析铺平了道路.
相关概念视频
Improving Translational Accuracy
3.5K
3.5K
Improving Translational Accuracy
14.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.0K
Causes of Similarity-Dissimilarity Effect
240
The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
240
Language and Cognition
693
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
693
Language Development
806
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
806
Per-Unit Sequence Models
407
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
407
