快速适应化学命名实体识别,使用少数镜头学习和LLM蒸
Yue Zhang1,2, Dionisios G Vlachos1,3, Dongxia Liu1,3
1Center for Plastics Innovation, University of Delaware, Newark, Delaware 19716, United States.
Journal of chemical information and modeling
|May 1, 2025
概括
本研究介绍了化学文本挖掘的一些名为实体识别 (NER) 模型. 该模型使用有限的数据和知识传输有效地从资源较少的领域提取化学实体.
科学领域:
- 计算化学计算化学
- 自然语言处理自然语言处理.
- 化学信息学 化学信息学
背景情况:
- 化学命名实体识别 (NER) 系统通常需要大量的注释数据.
- 像催化剂这样的低资源领域面临着由于有限的注释化学实体的挑战,阻碍了科学进步.
- 现有的NER模型难以满足专业化工领域的数据需求.
研究的目的:
- 开发一个几次射击的NER模型,用于在低资源环境中高效地提取化学实体.
- 为了使NER系统能够快速适应新的化学实体类型,并提供最小的注释.
- 解决专业化工领域数据饥饿的NER模型的局限性.
主要方法:
- 提出了一种使用度量学习方法的几次射击NER模型.
- 从高资源化学领域转移到低资源化学领域的实体相似性知识.
- 在基准数据集上验证了模型,该数据集来自六个现有的化学NER数据集.
- 探索用大型语言模型 (LLM) 标注数据训练模型.
主要成果:
- 每个实体类型只需5个示例,实现了合理的业绩.
- 通过越来越多的注释示例,证明了持续的绩效改进.
- 展示了模型能够有效地适应新的化学实体类型的能力.
- 验证了基于LLM的培训方法,以快速适应NER系统.
结论:
- 拟议的少数镜头NER模型显著减少了化学实体认可的注释要求.
- 这种方法有助于在催化剂等特殊化学领域取得更快的进展.
- 利用LLM为创建高效,适应性和内部化学NER解决方案提供了一条新的途径.
相关概念视频
Olefin Metathesis Polymerization: Acyclic Diene Metathesis (ADMET)
1.9K
Acyclic diene metathesis polymerization or ADMET polymerization involves cross-metathesis of terminal dienes, such as 1,8-nonadiene, to give linear unsaturated polymer and ethylene. As ADMET is a reversible process, the formed ethylene gas must be removed from the reaction mixture to complete the polymerization process.
Similar to cross-metathesis, ADMET also involves the formation of metallacyclobutane intermediate by [2+2] cycloaddition of one of the double bonds of a terminal diene with...
Similar to cross-metathesis, ADMET also involves the formation of metallacyclobutane intermediate by [2+2] cycloaddition of one of the double bonds of a terminal diene with...
1.9K
Drug Discovery: Overview
7.2K
Drug discovery is a multifaceted process involving extensive screening, testing, and optimization of lead compounds to identify potential new drugs for therapeutic use. It combines several approaches, including screening large numbers of natural products, chemical modification of known active molecules, identification of new drug targets, and rational design based on biological mechanisms and drug-receptor structure. These approaches are carried out in both academic research laboratories and...
7.2K
Nucleophilic Aromatic Substitution of Aryldiazonium Salts: Aromatic SN1
2.0K
Treating arylamines with nitrous acid gives aryldiazonium salts that are effective substrates in nucleophilic aromatic substitution reactions. The diazonio group in these salts can be easily displaced by different nucleophiles, yielding a wide variety of substituted benzenes. The leaving group departs as nitrogen gas, and this easy elimination is the driving force for the substitution reaction.
In the Sandmeyer reaction, for example, the diazonio group is replaced by a chloro, bromo,...
In the Sandmeyer reaction, for example, the diazonio group is replaced by a chloro, bromo,...
2.0K
Elaborative Rehearsals
64
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
The effectiveness of...
64
Predicting Products: SN1 vs. SN2
13.1K
Nucleophilic substitution reactions of alkyl halides can proceed via an SN1 or an SN2 mechanism. While in SN2 reactions, the nucleophile attacks the substrate simultaneously as the leaving group departs, in SN1 reactions, the substrate first dissociates to give the carbocation intermediate. Various factors such as the structure of the substrate, the strength of the nucleophile, and the nature of the solvent promote one mechanism over the other.
With increased substitution on the alkyl halide,...
With increased substitution on the alkyl halide,...
13.1K
Electrophilic Aromatic Substitution: Overview
10.4K
In an electrophilic aromatic substitution reaction, an electrophile substitutes for a hydrogen of an aromatic compound.
10.4K


