生物Mistral-NLU:通过指令调整实现更普遍的医学语言理解
Yujuan Velvin Fu1, Giridhar Kaushik Ramachandran2, Namu Park1
1University of Washington, Seattle, WA, USA.
概括
本研究介绍了BioMistral-NLU,这是一个专门用于医疗自然语言理解 (NLU) 任务的大型语言模型 (LLM). 生物Mistral-NLU表现出比一般的LLM如ChatGPT更高的性能,改善了医疗数据的理解.
科学领域:
- 人工智能的人工智能
- 计算语言学 计算语言学
- 生物医学信息学 生物医学信息学
背景情况:
- 大型语言模型 (LLM) 显示了广泛的概括,但与专门的医学自然语言理解 (NLU) 斗争.
- 医学NLU需要领域知识,详细的文本理解和结构化数据提取,这是一般LLM缺乏的领域.
研究的目的:
- 通过对精心策划的医疗指令调整数据集进行LLM微调,开发一个可泛化的医疗NLU模型.
- 通过统一的提示策略和多样化的指令调整,提高LLM在专业医疗NLU任务上的性能.
主要方法:
- 为7个NLU任务提出了一个统一的提示格式.
- 策划了MNLU-Instruct,这是一个来自开源公司的医疗NLU指令调整数据集.
- 在MNLU-Instruct上微调了BioMistral LLM,以创建BioMistral-NLU模型.
主要成果:
- 在BLUE和BLURB基准的零射击评估中,BioMistral-NLU的表现优于基础BioMistral,ChatGPT和GPT-4.
- 对各种NLU任务的指令调整增强了零射击通用化.
- 一个无关数据集的提示策略改善了跨任务的性能.
结论:
- 拟议的BioMistral-NLU模型有效地弥合了LLM在专业医疗NLU任务中的差距.
- 对各种医疗NLU任务的指令调整显著提高了LLM的概括性.
- 该方法为开发特定领域的LLM提供了一个有希望的方法.
相关概念视频
02:07Improving Translational Accuracy
2.5K
2.5K
01:30Guidelines for Nursing Documentation I
1.0K
Quality documentation and reporting share essential characteristics that ensure they are practical and valuable resources for those who use them. These characteristics are:
Factual:
The following points emphasize the significance of upholding accurate and unbiased documentation in healthcare.
Factual:
The following points emphasize the significance of upholding accurate and unbiased documentation in healthcare.
1.0K
01:31Translation
14.7K
Translation is the process of synthesizing proteins from the genetic information carried by messenger RNA (mRNA). Following transcription, it constitutes the final step in the expression of genes. This process is carried out by ribosomes, complexes of protein and specialized RNA molecules. Ribosomes, transfer RNA (tRNA), and other proteins produce a chain of amino acids—the polypeptide—as the end product of translation.
Translation Produces the Building Blocks of Life
Proteins are...
Translation Produces the Building Blocks of Life
Proteins are...
14.7K
01:27Language and Cognition
336
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
336
01:22Purposive Learning
105
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
105
01:21Health Literacy
4.0K
Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative...
4.0K