用大型语言模型从科学文本中提取结构化的信息
John Dagdelen1,2, Alexander Dunn1,2, Sanghoon Lee1,2
1Lawrence Berkeley National Laboratory, Berkeley, CA, USA.
Nature communications
|February 15, 2024
概括
我们开发了一种简单的机器学习方法,使用大型语言模型从文本中提取结构化的科学知识. 这种方法有效地为材料化学研究创建了大型数据库.
科学领域:
- 材料化学 材料化学
- 计算科学 计算科学
- 自然语言处理自然语言处理.
背景情况:
- 从科学文献中提取结构化知识是机器学习的一个重大挑战.
- 现有的方法可能缺乏灵活性来处理不同类型的科学数据.
研究的目的:
- 为共同命名实体识别和关系提取提供一种简单,易于使用的方法.
- 为了证明微调预训练的大型语言模型 (LLM) 的有效性,用于科学知识提取.
- 从科学研究论文创建大型,结构化的数据库.
主要方法:
- 微调预训练的LLM (GPT-3,Llama-2) 用于命名实体识别和关系提取.
- 将该方法应用于三种材料化学任务:剂-宿主链接,金属有机框架目录以及成分/相位/形态/应用提取.
- 处理文本从单个句子到整个段落.
主要成果:
- 成功提取复杂科学知识的结构化记录.
- 在输出格式中表现出灵活性,包括简单的英语句子和JSON对象.
- 展示了创建大型,专门的科学知识数据库的潜力.
结论:
- 拟议的方法为自动化科学知识提取提供了一个高度灵活和可访问的途径.
- 微调的LLMs是从非结构化的科学文本构建结构化数据库的可行策略.
- 这种方法可以显著加快科学数据的研究和开发的策划.
更多相关视频
相关概念视频
Ligand Binding Sites
12.8K
Proteins are dynamic macromolecules that carry out a wide variety of essential processes; however, the activities of most proteins depend on their interactions with other molecules or ions, known as ligands.
Protein-ligand interactions are quite specific; even though numerous potential ligands surround a cellular protein at any given time, only a particular ligand can bind to that protein. Moreover, a ligand binds only to a dedicated area on the surface of the protein, known as the...
Protein-ligand interactions are quite specific; even though numerous potential ligands surround a cellular protein at any given time, only a particular ligand can bind to that protein. Moreover, a ligand binds only to a dedicated area on the surface of the protein, known as the...
12.8K
Improving Translational Accuracy
2.6K
2.6K
Leaky Scanning
5.1K
During most eukaryotic translation processes, the small 40S ribosome subunit scans an mRNA from its 5' end until it encounters the first start AUG codon. The large 60S ribosomal subunit then joins the smaller one to initiate protein synthesis. The location of the translation initiation is largely determined by the nucleotides near the start codon as there may be multiple translation initiation sites present on the mRNA. Marilyn Kozak discovered that the sequence RCCAUGG (where R...
5.1K
Super-resolution Fluorescence Microscopy
7.0K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.0K


