通过潜在知识图表实现基于大型语言模型的图形数据增强的民主化
Yushi Feng1, Tsai Hor Chan1, Guosheng Yin1
1Department of Statistics and Actuarial Science, School of Computing and Data Science, The University of Hong Kong, Hong Kong Special Administrative Region of China.
概括
DemoGraph通过使用大型语言模型 (LLM) 来从文本提示生成知识图表来增强图表表示学习. 这种以上下文为导向的方法改善了数据增强,特别是在电子健康记录 (EHR) 中.
科学领域:
- 图形表示学习学习学习图形表示.
- 人工智能的人工智能是人工智能.
- 数据科学是数据科学.
背景情况:
- 由于数据稀缺和噪音,图形数据增强至关重要.
- 现有的方法往往忽略了上下文信息,只关注图形结构.
- 目前基于大型语言模型 (LLM) 的图形学习方法通常是白盒,限制了可访问性.
研究的目的:
- 提出一个由LLMs指导的黑子,上下文驱动的图形数据增强方法.
- 利用LLM生成的知识图 (KG) 来捕捉文本中的结构互动.
- 通过整合上下文信息和改善可访问性来增强图形学习.
主要方法:
- 开发了DemoGraph,一种使用LLMs进行上下文驱动图形增强的黑子方法.
- 使用的文本提示指导LLMs生成KG,捕捉结构互动.
- 实现了一个动态合并方案,用于生成KG的随机集成.
- 引入了细分感知提示和指令微调以控制增强图形稀疏性.
主要成果:
- 与现有的图形数据增强方法相比,DemoGraph显示出更高的有效性.
- 该方法在图形学习任务中显著改善,特别是在电子健康记录 (EHR) 中.
- 观察到增强的预测性能和可解释性,验证了该方法的上下文知识利用.
结论:
- 通过结合上下文信息,DemoGraph有效地解决了现有的图形增强技术的局限性.
- 黑盒,LLM指导的方法使高级图形学习民主化.
- 该方法显示了对于需要丰富的上下文理解的应用程序的强大潜力,例如EHR分析.
相关概念视频
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
129
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
129
Vector Algebra: Graphical Method
13.9K
Vectors can be multiplied by scalars, added to other vectors, or subtracted from other vectors. The vector sum of two (or more) vectors is called the resultant vector or, for short, the resultant.
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
13.9K
Language and Cognition
450
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
450
Language Development
455
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
455
Improving Translational Accuracy
2.7K
2.7K
Generalization, Discrimination, and Extinction
813
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
813


