合成数据蒸使得在规模上提取临床信息成为可能
Elizabeth Geena Woo1,2,3, Michael C Burkhart1,3, Emily Alsentzer4
1Department of Medicine, Biological Sciences Division, University of Chicago, Chicago, IL, USA.
NPJ digital medicine
|May 10, 2025
概括
合成数据蒸使较小的大语言模型 (LLM) 能够与较大的模型相比地执行临床信息提取任务. 这种方法降低了计算成本,并提高了在医疗保健环境中部署LLM的隐私.
科学领域:
- 人工智能在医学中的应用
- 自然语言处理自然语言处理.
- 计算健康 计算健康
背景情况:
- 大语言模型 (LLM) 提供了临床笔记信息提取的潜力.
- 部署LLMs面临诸如高计算成本和隐私问题等挑战.
研究的目的:
- 调查合成数据蒸以微调更小的,开源的LLM用于临床信息提取.
- 为了实现与较大的模型可比的性能,同时实现本地部署或降低云成本.
主要方法:
- 使用Llama-3.1-70B-Instruct生成合成问答训练对.
- 使用合成数据微调较小的拉玛模型 (例如,8B,3B,1B参数).
- 根据合成临床试验标准,i2b2 2018挑战和apixaban试验标准进行评估.
主要成果:
- 8B参数模型在所有评估任务中都表现出高准确度,有时甚至超过了更大的教师模型.
- 精细调整具有挑战性的问题提高了表现,突出了有针对性的培训的有效性.
- 在3B和1B参数模型中观察到一个明显的尺寸-性能权衡.
结论:
- 合成数据蒸是一种可行的策略,用于创建高效和准确的临床信息提取的LLM.
- 这种方法促进了LLM在医疗保健中的可扩展部署,解决了成本和隐私障碍.
相关概念视频
Data Collection I
5.9K
Data collection gathers information needed to make accurate judgments about a patient's present condition. During a health history interview, subjective data is collected from the patient, their caregivers, or family members, and objective data is collected through observations and physical assessment. Patients are the primary source of subjective data. Thus information gathered from patients through interviews, observations, and physical examination is primary data. Secondary sources of...
5.9K
Clinical Trials
6.6K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
6.6K
Clinical Trials: Overview
2.5K
Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
2.5K
Statistical Software for Data Analysis and Clinical Trials
428
Statistical software is pivotal in data analysis and clinical trials by providing tools to analyze data, draw conclusions, and make predictions. These software packages range from simple data management applications to complex analytical platforms, supporting various statistical tests, models, and simulation techniques. Their significance lies in their ability to handle vast amounts of data with precision and efficiency, enabling researchers to validate hypotheses, identify trends, and make...
428
Nursing Clinical Information System
720
Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
720
Issues And Trends In Healthcare Delivery System
5.5K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.5K


