一种基于词意感应的词意嵌入构造方法
Yujia Sun1,2, Jan Platoš3
1Department of Computer Science, Technical University of Ostrava, 17. Listopadu 2172/15, 70800, Ostrava-Poruba, Czech Republic. yujia.sun.st@vsb.cz.
Scientific reports
|August 9, 2023
概括
这项研究引入了一种新的方法,用于将多个单词感应编码到单个矢量中,从而改善单词感应和嵌入多种词语的准确性.
科学领域:
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
- 机器学习 机器学习
背景情况:
- 多词性,即一个单词存在多个含义,在自然语言理解方面提出了重大挑战.
- 精确的词语意义的分歧对于各种NLP任务至关重要,包括信息检索和机器翻译.
研究的目的:
- 提出一种新的方法,将多种词的多重意义编码为单个向量表示.
- 为了增强词语感应和词语感应嵌入的准确性.
- 为了解决自然语言固有的模糊性.
主要方法:
- 使用双层双向长期短期记忆神经网络和自我注意机制来提取上下文词信息.
- 应用了改进的K-means集群算法,优化了密度峰集群和共弦相似性,用于词意感应.
- 产生独特的词语意义嵌入式表示对多种词的表示.
主要成果:
- 拟议的方法在词意感应方面表现出优异的表现,相比于传统的指标,如欧几里德距离,皮尔森相关性和KL-分歧.
- 生成的词感嵌入比通过平均转移,DBSCAN,光谱聚类和聚合聚类算法产生的更准确.
- 实验结果验证了拟议方法在处理多重化学物中的有效性.
结论:
- 开发的方法成功将多个词感编码到单个矢量中,为多语法提供了强大的解决方案.
- 这种方法显著改善了词语感应和嵌入精度,推进了自然语言处理领域.
- 这些发现为计算语言学社区提供了有价值的贡献,以更好地理解语义.
相关概念视频
Induction
4.1K
An emf is induced when the magnetic field in a coil is changed by pushing a bar magnet into or out of the coil. emfs of opposite signs are produced by motion in opposite directions, and the directions of emfs are also reversed by reversing poles. The same results are produced if the coil is moved rather than the magnet—it is the relative motion that is important. The faster the motion, the greater the emf. Additionally, there is no emf when the magnet is stationary relative to the coil.
A...
A...
4.1K
Inductive Reasoning
60.6K
Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
60.6K
Inductors
440
An inductor is a passive component built to store energy within its magnetic field. It can be fabricated by coiling a wire around a magnetic core. When current is permitted to flow through this inductor, it is observed that the voltage across the inductor is directly proportional to the time rate of change of the current. Mathematically,
440
Induced-fit Model
81.1K
Most chemical reactions in cells require enzymes—biological catalysts that speed up the reaction without being consumed or permanently changed. They reduce the activation energy needed to convert the reactants into products. Enzymes are proteins, that usually work by binding to a substrate—a reactant molecule that they act upon.
Enzymes exhibit substrate specificity, meaning that they can only bind to certain substrates. This is mainly determined by the shape and chemical...
Enzymes exhibit substrate specificity, meaning that they can only bind to certain substrates. This is mainly determined by the shape and chemical...
81.1K
Self-Inductance
2.4K
Mutual inductance arises when a current in one circuit produces a changing magnetic field that induces an emf in another circuit. On the other hand, self-inductance arises when the current passing through the circuit changes, creating a changing magnetic flux, resulting in inductance in the same circuit.
Consider a circuit connected to an AC source. As the current varies with time, the magnetic flux through the circuit correspondingly changes. Faraday's law tells us that an emf would...
Consider a circuit connected to an AC source. As the current varies with time, the magnetic flux through the circuit correspondingly changes. Faraday's law tells us that an emf would...
2.4K
Induced Electric Dipoles
4.3K
A permanent electric dipole orients itself along an external electric field. This rotation can be quantified by defining the potential energy because the external torque does work in rotating it. Then, the potential energy is minimum at the parallel configuration and maximum at the antiparallel configuration. While the former is a stable equilibrium, the latter is an unstable equilibrium.
Since the absolute value of potential energy holds no physical meaning, its zero value can be chosen as per...
Since the absolute value of potential energy holds no physical meaning, its zero value can be chosen as per...
4.3K


