VetLLM:从兽医笔记中预测诊断的大型语言模型
Yixing Jiang1, Jeremy A Irvin, Andrew Y Ng
1Stanford University, Stanford, CA, United States.
Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing
|December 31, 2023
概括
大型语言模型 (LLM) 显示了兽医自动诊断编码的前景. 像VetLLM这样的微调LLM显著提高了准确性,即使数据有限,也超过了传统方法.
科学领域:
- 兽医信息学 兽医信息学
- 自然语言处理自然语言处理.
- 机器学习 机器学习
背景情况:
- 从兽医笔记中编码准确的诊断对于医学和公共卫生研究至关重要.
- 使用基于规则或监督学习模型的现有方法通常是繁的,缺乏可转移性.
研究的目的:
- 评估开源大型语言模型 (LLM) 在兽医中用于自动诊断编码的有效性.
- 通过对兽医临床文本进行微调的LLM来证明可以实现的性能改善.
主要方法:
- 在兽医编码基准 (CSU和PP) 上评估了Alpaca-7B的零射击性能.
- 开发和微调一个专门的LLM,VetLLM,在兽医笔记的子集.
- 将VetLLM的表现与最先进的监督模型进行了比较.
主要成果:
- 阿尔帕卡-7B实现了0.538 (CSU) 和0.389 (PP) 的零射击F1得分.
- 在5000纸币上微调的VetLLM获得了0.747 (CSU) 和0.637 (PP) 的F1得分,超过了监督模型.
- 数据高效微调显示,与100,000多张笔记训练的模型相比,只有200张笔记的模型表现优越.
结论:
- 开源的LLM提供了一种可行和有效的方法,用于从兽医笔记中编码诊断.
- 微调的LLMs为兽医学中的临床文本处理提供了一个强大的,数据效率高的范式.
- 这种方法具有很大的潜力,可以利用临床数据推进医学和公共卫生研究.
相关概念视频
Classification of Illness
The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe and...
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe and...
Formulating and Validating Nursing Diagnosis I
A nursing diagnosis is written when the nurse recognizes a cluster of essential patient data indicating health problems treated with independent nursing interventions. The standardized terminologies of a nursing diagnosis help nurses identify and treat patients' problems. Every electronic health record that uses nursing diagnosis must employ standard diagnostic terminology. Developing an efficient, individualized care plan begins with accurate nursing diagnoses.
There are thirteen domains for...
There are thirteen domains for...
Formulating and Validating Nursing Diagnosis II
Nursing diagnoses represent a problem validated by major defining characteristics. There are four categories of nursing diagnoses: problem-focused, risk, health promotion or wellness, and syndrome. The anatomy of a nursing diagnosis includes three components: problem statement or diagnostic label, defining characteristics, and related factors.
Risk nursing diagnoses represent clinical judgments of an individual, family, or community more vulnerable to developing the health problem than others...
Risk nursing diagnoses represent clinical judgments of an individual, family, or community more vulnerable to developing the health problem than others...
Sensitivity, Specificity, and Predicted Value
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
Introduction to Language of Pathophysiology l
Pathophysiology investigates how biological mechanisms—typically starting at the cellular level—disrupt normal bodily functions. It bridges anatomy and physiology to explain the progression of disease. With this foundation, it is important to understand the following key terms used to describe disease processes: Diagnosis:The process of identifying a disease using clinical evaluation, including signs (objective evidence like rashes), symptoms (subjective experiences like pain), laboratory test...
Introduction to Language of Pathophysiology ll
This lesson explores key terms that describe how diseases progress, their outcomes, and their distribution in populations.Diagnostic tests identify diseases and monitor treatment. These include blood and urine tests, biopsies, imaging (X-ray, MRI), and detection of infectious agents.Remission is a reduction or disappearance of symptoms.Exacerbation refers to the worsening of symptoms, such as increased wheezing during an asthma attack.A precipitating factor triggers an acute episode, while a...


