生物医学文本的简单语言改编使用LLMs:评估指标的比较
Primoz Kocbek1,2, Leon Kopitar1, Gregor Stiglic1,3
1University of Maribor, Faculty of Health Sciences, Maribor, Slovenia.
Studies in health technology and informatics
|August 8, 2025
概括
大型语言模型 (LLM) 可以简化复杂的生物医学文本,以提高健康素养. 与其他方法相比,gpt-4o-mini模型在简化文本方面表现优异.
科学领域:
- 生物医学信息学 生物医学信息学
- 自然语言处理自然语言处理.
- 卫生沟通健康沟通
背景情况:
- 生物医学文本由于其复杂性,往往对健康素养构成障碍.
- 简化这些文本对于改善公众对健康信息的理解至关重要.
研究的目的:
- 调查大型语言模型 (LLM) 在简化生物医学文本方面的有效性.
- 为了比较不同的LLM方法,包括提示模板,AI代理和微调,以简化文本.
主要方法:
- 利用公共数据集对生物医学摘要的简单语言调整.
- 开发并评估了基线 (提示模板),两个AI代理,以及微调方法.
- 采用了定量指标 (弗莱什-金凯德,SMOG,SARI,BERTScore,G-Eval) 和定性指标 (利克特尺度).
- 选择的OpenAI gpt-4o和gpt-4o迷你模型进行评估.
主要成果:
- 在简化生物医学文本方面,gpt-4o-mini模型表现出卓越的性能.
- 与其他方法相比,微调 (FT) 方法表现不佳.
- 基于LLM的G-Eval指标显示出有希望的结果,与定性评估保持一致.
结论:
- 通过简化生物医学文本,LLM,特别是gpt-4o-mini,显示了通过简化生物医学文本来提高健康素养的巨大潜力.
- 该G-Eval指标提供了一个可靠的,LLM驱动的方法来评估文本简化质量.
更多相关视频
相关概念视频
02:07Improving Translational Accuracy
2.7K
2.7K
01:16Bioequivalence: Overview
1.2K
Pharmaceutical equivalents, by definition, are drug products with the same active ingredient in the same quantities, encapsulated in identical dosage forms, and intended for the same administration routes. These pharmaceutical equivalents are deemed bioequivalent if the bioavailability of the active entity in the drug preparations is similar. Moreover, pharmaceutical equivalents demonstrating bioequivalence are also regarded as therapeutically equivalent. This means that when used as directed,...
1.2K
01:21Health Literacy
4.1K
Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative...
4.1K
02:26Comparing Copy Number Variations and SNPs
17.9K
Sequencing of the human genome has opened up several best-kept secrets of the genome. Scientists have identified thousands of genome variations that exist within a population. These variations can be a single nucleotide or a larger chromosomal variation.
Copy number variations or CNVs are the structural variations that cover more than 1kb of DNA sequence. The single nucleotide polymorphism (SNP), on the other hand, is a single nucleotide change or a point mutation that is found in more than 1%...
Copy number variations or CNVs are the structural variations that cover more than 1kb of DNA sequence. The single nucleotide polymorphism (SNP), on the other hand, is a single nucleotide change or a point mutation that is found in more than 1%...
17.9K
01:11Assessing Blood pressure in the Leg
4.4K
Proper measurement of leg blood pressure is a critical skill for healthcare providers, ensuring precise and reliable readings. When performed correctly, this procedure informs patient care and enhances the efficacy of interventions. The following text outlines step-by-step guidelines to measure blood pressure in the leg, providing clarity and ease of understanding for practitioners.
Preparation:
Preparation:
4.4K
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
174
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
174