VLExpan:一个视觉增强的LLM框架,具有对实体集扩展的诱导和演策略
Yinan Wu1, Qianyi Dong1, Jingping Liu1
1School of Information Science and Engineering, East China University of Science and Technology, Shanghai, 200237, China.
概括
本研究介绍了VLExpan,这是一个新的框架,通过将视觉信息与大型语言模型 (LLM) 集成来增强实体集扩展 (ESE). 与传统的纯文本方法相比,VLExpan提高了细粒度的ESE,并减少了错误.
科学领域:
- 自然语言处理自然语言处理.
- 计算机视觉 计算机视觉
- 获取知识 获取知识
背景情况:
- 现有的实体集扩展 (ESE) 方法主要使用文本信息,限制细粒度扩展和更少常见实体的召回.
- 传统的ESE启动框架容易发生错误传播,影响整体性能.
- 需要ESE方法,利用多式联运信息来提高准确性和稳定性.
研究的目的:
- 为改进实体集扩展提出一个视觉增强的LLM框架,具有诱导和演策略 (VLExpan).
- 解决纯文本ESE方法的局限性,包括细粒度扩展和错误传播.
- 通过整合视觉数据来增强长尾实体的回忆.
主要方法:
- VLExpan使用视觉语言模型集成视觉信息,用于代的种子实体扩展.
- 大型语言模型 (LLM) 用于从种子实体中诱导类名称.
- 演策略通过诱导的类名和LLM功能来完善扩展过程.
主要成果:
- 在实体集扩张业绩方面,VLExpan表现出显著的改善.
- 该框架在基准数据集上实现了3.36% (MAP@10) 和4.51% (MAP@20/MAP@50) 的平均得分改善.
- 实验结果验证了将视觉信息和LLM纳入ESE的有效性.
结论:
- 通过有效地将视觉和文本数据与LLMs相结合,VLExpan为实体集扩展提供了一种优越的方法.
- 拟议的框架减轻了传统方法固有的错误传播.
- 通过实现更准确和更全面的实体集发现,VLExpan在知识获取领域取得了进展.
相关概念视频
Inductive Reasoning
64.8K
Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
64.8K
Deductive Reasoning
64.1K
Deductive reasoning, or deduction, is the type of logic used in hypothesis-based science. In deductive reasoning, the pattern of thinking moves in the opposite direction as compared to inductive reasoning, which means that it uses a general principle or law to predict specific results. From those general principles, a scientist can deduce and predict the specific results that would be valid as long as the general principles are valid.
For example, a researcher can deduce specific predictions...
For example, a researcher can deduce specific predictions...
64.1K
Constraints and Statical Determinacy
940
In structural engineering, the equilibrium of a system is not only determined by its equations of equilibrium but also with the help of constraints. Constraints refer to restrictions on the motion of a system. The proper combinations of constraints can minimize the total number of constraints needed to maintain a system in mechanical equilibrium. When this happens, the system is said to be statically determinate. For such systems, the unknown reaction supports can be estimated using equilibrium...
940
Natural and Artificial Concepts
538
In psychology, concepts can be divided into two categories: natural and artificial. Natural concepts are formed through direct or indirect experiences. For example, consider the concept of snow. If you live in a place with regular snowfall, such as Essex Junction, Vermont, you know snow through direct experiences. You’ve seen it fall, touched it, shoveled it, and played in it. You recognize its texture, appearance, and even its smell. In contrast, if you live on an island like Saint...
538
Mathematical Induction
222
Mathematical induction is a structured method of proof used to confirm the truth of statements involving natural numbers. Consider the sum of the first n natural numbers:This formula describes a pattern that appears to hold true as more terms are added. To verify that it is valid for all natural numbers, mathematical induction proceeds in two essential steps. The first is the base case, where the formula is tested for the initial value, typically n = 1. Substituting into both sides confirms the...
222
Inductive Effects on Chemical Shift: Overview
2.0K
The protons in unsubstituted alkanes are strongly shielded with chemical shifts below 1.8 ppm. Methine, methylene, and methyl protons appear at approximately 1.7, 1.2 and 0.7 ppm, while the proton signal from methane appears at 0.23 ppm. An electronegative substituent, such as chlorine, withdraws the electron density from the protons, increasing their chemical shift. Progressive substitution of the hydrogens in methane by chlorine shifts the proton signals increasingly downfield, to 3.05 ppm in...
2.0K

