Me-LLaMA:医学基金会用于全面文本分析和超越的大型语言模型
Qianqian Xie1, Qingyu Chen1, Aokun Chen2
1Yale University.
Research square
|January 7, 2025
概括
Me-LLaMA是一个新的开源医疗大语言模型 (LLM) 家族,集成了广泛的医学知识,以提高医疗保健任务的性能. 这些模型在医学文本分析和临床病例诊断方面优于现有的LLM.
科学领域:
- 人工智能在医学中的应用
- 自然语言处理自然语言处理.
- 大型语言模型 (LLM)
背景情况:
- 一般领域的大型语言模型 (LLM) 缺乏专门的医学知识,限制了它们在医疗保健中的有效性.
- 现有的医学LLM往往难以平衡特定领域的知识与强大的指令遵循能力.
研究的目的:
- 开发Me-LLaMA,一个新的开源医学LLMs家族.
- 通过整合专业知识和指令调整,提高医学文本分析和临床病例诊断的LLM绩效.
主要方法:
- 通过不断预训练和指令调整LLaMA2模型,开发了Me-LLaMA基础和聊天增强模型 (13B和70B).
- 利用了一个全面的医疗数据集:来自生物医学文献和临床笔记的129B预训练令牌和214K指令调样本.
- 在12个基准数据集和复杂的临床病例诊断中对6个医学文本分析任务进行了Me-LLaMA的评估.
主要成果:
- 在零射击和监督学习环境中,Me-LLaMA模型的表现优于LLaMA和其他开源医学LLM.
- 针对特定任务的指令调整的Me-LLaMA超越了领先的商业LLM,在多个数据集上表现优于ChatGPT和GPT-4.
- 在诊断复杂的临床病例方面,Me-LLaMA的性能与ChatGPT和GPT-4相美.
结论:
- 将特定领域的持续预培训与指令调整相结合,对于开发有效的医学LLM至关重要.
- Me-LLaMA 在各种医学文本分析任务和临床应用中显著提高了性能.
- 公开发布的Me-LLaMA旨在促进创新,并为研究人员和从业人员推进医学AI.
更多相关视频
06:48Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
Published on: June 25, 2019
9.1K
09:09Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
Published on: September 27, 2024
397
相关概念视频
01:10Higher Mental Functions of the Brain: Language
729
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
729
01:27Language and Cognition
321
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
321
02:07Improving Translational Accuracy
8.7K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
8.7K
01:11Genetic Lingo
100.8K
Overview
100.8K