在ICF分类中评估LLM的表现:从医学和一般模型的见解
概括
本研究探讨使用大型语言模型 (LLM) 来自动化国际功能,残疾和健康分类 (ICF) 从医疗文本编码. 初步结果表明,专门的医学LLM在这个复杂的任务中可能不会超过一般的LLM.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 卫生分类系统 卫生分类系统
背景情况:
- 非结构化的临床文本数据,包括患者的事和见解,在医疗保健中往往未得到充分利用.
- 大型语言模型 (LLM) 为处理和结构化这些复杂的医疗数据提供了潜力.
- 世界卫生组织的功能,残疾和健康国际分类 (ICF) 为描述健康和残疾提供了一个标准化的框架.
研究的目的:
- 调查医学上微调的LLM用于自动ICF分类的应用.
- 为了比较医疗LLM (MedAlpaca,Meditron) 与通用LLM (ChatGPT,Claude) 在处理真实医疗病例中的效率.
- 为了评估在康复和重症监护单位数据的背景下,专业与一般LLMs的表现.
主要方法:
- 使用医学上微调的LLM (MedAlpaca,Meditron) 和通用LLM (ChatGPT,Claude).使用医学上微调的LLM (MedAlpaca,Meditron) 和通用LLM (ChatGPT,Claude).
- 将LLM应用到来自康复和重症监护机构的真实医学病例数据.
- 对不同LLM用于自动ICF代码生成的性能进行了比较.
主要成果:
- 医学LLM显示了ICF分类任务的潜力.
- 一般目的的LLM与专业医疗LLM的表现相当.
- ICF分类的复杂性可能需要比当前模型提供更深入的上下文理解.
结论:
- 使用LLM进行自动ICF分类是可行的,但需要仔细选择模型.
- 专门的医疗LLM在复杂的ICF编码中并非本质上优于一般的LLM.
- 需要进一步的研究来提高LLM的上下文理解,以提高医学分类的准确性.
相关概念视频
Classification of Illness
8.5K
The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
8.5K
Improving Translational Accuracy
14.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.0K
Improving Translational Accuracy
3.5K
3.5K


