对于复杂结构化任务的本地大语言模型
V K Cody Bumgardner1, Aaron Mullen1, Samuel E Armstrong1
1University of Kentucky, Lexington, KY.
概括
这项研究表明,使用本地微调的大型语言模型 (LLM) 可以有效地从病理学报告中提取病情代码. LLaMA模型的表现优于其他模型,特别是在复杂任务的大数据集上.
科学领域:
- 自然语言处理自然语言处理.
- 医疗信息学 医疗信息学
- 机器学习 机器学习
背景情况:
- 从非结构化的临床文本中提取结构化数据是一项挑战.
- 大型语言模型 (LLM) 提供先进的语言理解,但通常需要大量的资源.
- 对LLM的本地培训可以优化对特定领域任务的性能.
研究的目的:
- 开发和评估一种方法,将LLM推理与结构化数据提取的本地培训相结合.
- 从外科病理学报告中提取病态代码,使用精心调整的LLMs.
- 为了比较不同LLM架构在此任务上的性能.
主要方法:
- 利用了超过15万份未经处理的外科病理学报告.
- 精心调整的本地LLM,包括LLaMA,BERT和LongFormer,用于生成指令跟踪.
- 从粗略描述,诊断和相关代码中提取结构化条件代码的评估模型.
主要成果:
- 基于LLaMA的模型在所有指标上显著优于BERT型模型.
- 对于复杂的,多标签的条件代码提取,LLaMA模型在大型数据集中表现出卓越的性能.
- 该方法成功地从特定领域的医学语言生成了结构化的输出.
结论:
- 将LLMs与本地培训相结合,为医疗领域的结构化生成任务提供了一种有效的方法.
- LLaMA模型具有很高的复杂性,大规模的医疗文本分析和条件代码提取的能力.
- 这种方法促进了LLM用于专业化,数据密集型临床应用的利用.
相关概念视频
01:20Structural Classification of Joints
3.3K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
3.3K
01:09Functional Classification of Joints
4.0K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
4.0K
01:30Typical Model Studies
354
Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
354
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
48
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
48
01:14Multicompartment Models: Overview
131
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
131
02:07Improving Translational Accuracy
10.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
10.1K