生成型的大型语言模型是万能文本分析引擎:文本对文本学习是你所需要的一切
Cheng Peng1, Xi Yang1,2, Aokun Chen1,2
1Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL 32611, United States.
概括
使用快速调整的统一生成型大语言模型 (LLM) 在5个主要的临床自然语言处理 (NLP) 任务中取得了最先进的结果,证明了"一个模式适用于所有"的能力.
科学领域:
- 临床自然语言处理 (NLP)
- 医疗保健中的人工智能
- 大型语言模型 (LLM)
背景情况:
- 临床NLP任务传统上需要专门的模型.
- 生成型LLM提供了一个潜在的统一方法.
- 快速调整使LLMs能够有效地适应.
研究的目的:
- 为主要的临床NLP任务开发和评估一个统一的文本对文本学习架构.
- 为了利用一个具有生成力的LLM,并迅速调整以提高性能.
- 为了演示该系统的
- 一个模式适用于所有人.
- 在临床NLP中的能力.
主要方法:
- 制定了7个临床NLP关键任务作为文本对文本问题.
- 使用了GatorTronGPT,一个统一的生成临床LLM (GPT-3架构,最多200亿个参数).
- 雇佣的提示调软提示和一个冷的LLM.
主要成果:
- 在7个临床NLP任务中的5个中实现了最先进的性能.
- 在概念/关系提取,概念规范化,缩写清晰化和自然语言推断方面表现优于之前的特定任务的变压器模型.
- 在临床概念和关系提取方面超越了之前基于提示的模型 (GatorTron-MRC).
结论:
- 具有即时调整的统一生成LLM对各种临床NLP任务有效.
- 这种方法提供了一个有前途的方法.
- 一个模式适用于所有人.
- 从培训到部署的解决方案.
- 与现有方法相比,观察到显著的性能增长.
相关概念视频
Non-equilibrium in the Cell
4.4K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.4K
Genetic Lingo
102.7K
Overview
102.7K
Genomics
36.3K
Genomics is the science of genomes: it is the study of all the genetic material of an organism. In humans, the genome consists of information carried in 23 pairs of chromosomes in the nucleus, as well as mitochondrial DNA. In genomics, both coding and non-coding DNA is sequenced and analyzed. Genomics allows a better understanding of all living things, their evolution, and their diversity. It has a myriad of uses: for example, to build phylogenetic trees, to improve productivity and...
36.3K
Synthetic Biology
4.7K
Synthetic biology is an interdisciplinary science that involves using principles from disciplines such as engineering, molecular biology, cell biology, and systems biology. It involves remodeling existing organisms from nature or constructing completely new synthetic organisms for applications such as protein or enzyme production, bioremediation, value-added macromolecule production, and the addition of desirable traits to crops, to name a few.
Golden rice
Golden rice is a genetically modified...
Golden rice
Golden rice is a genetically modified...
4.7K
Genome Annotation and Assembly
18.8K
The genome refers to all of the genetic material in an organism. It can range from a few million base pairs in microbial cells to several billion base pairs in many eukaryotic organisms. Genome assembly refers to the process of taking the DNA sequencing data and putting it all back together in a correct order to create a close representation of the original genome. This is followed by the identification of functional elements on the newly assembled genome, a process called genome annotation.
18.8K
Improving Translational Accuracy
10.3K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
10.3K


