使用生成型大语言模型进行放射学报告注释:比较分析
Bayan Altalla'1,2, Ashraf Ahmad2, Layla Bitar3
1Office of Scientific Affairs and Research, King Hussein Cancer Center, Amman, Jordan.
International journal of biomedical imaging
|February 19, 2025
概括
像GPT-4这样的大型语言模型 (LLM) 在医疗文档中表现有前途,采用检索增强生成 (RAG) 产生准确的放射学报告印象. 快速设计对于优化医疗保健中的LLM绩效至关重要.
科学领域:
- 人工智能在医学中的应用
- 医疗保健的自然语言处理.
- 放射学 信息学 信息学
背景情况:
- 大型语言模型 (LLM) 展示了适用于医疗任务的越来越多的能力.
- 需要对LLM,特别是GPT-3.5和GPT-4在医疗文档中的潜力进行彻底评估.
- 自动生成放射学报告的印象可以减轻医疗保健专业人员的工作负担.
研究的目的:
- 对GPT-3.5和GPT-4在注释放射学报告和从胸部CT扫描生成印象中的性能进行比较分析.
- 评估在语境学习 (ICL) 和检索增强生成 (RAG) 对于印象生成的有效性.
- 调查快速设计对医学总结中的LLM绩效的影响.
主要方法:
- 使用零射击和少数射击学习场景对GPT-3.5和GPT-4进行比较分析.
- 在语境学习 (ICL) 和检索增强生成 (RAG) 技术的应用.
- 使用ROUGE,教师相似性和BERTScore指标进行评估,以评估n-gram,上下文和语义相似性.
主要成果:
- 与GPT-3.5相比,GPT-4在学习场景中显示出明显的绩效差异.
- 检索增强生成 (RAG) 实现了0.92的优异BERTScore,表明了高语义准确性.
- 无论是GPT-3.5还是GPT-4,都保持了高的语言音调忠实度 (讲师相似度~0.92),突出了即时的影响.
结论:
- 提示设计是优化LLM性能以产生准确的医疗印象的关键因素.
- 检索增强生成显示了产生语义丰富和上下文相关的放射学报告印象的巨大潜力.
- 在医疗保健实践中将GPT-4等高级LLM标准化整合,可以提高文件的效率和准确性.
相关概念视频
Genome Annotation and Assembly
18.8K
The genome refers to all of the genetic material in an organism. It can range from a few million base pairs in microbial cells to several billion base pairs in many eukaryotic organisms. Genome assembly refers to the process of taking the DNA sequencing data and putting it all back together in a correct order to create a close representation of the original genome. This is followed by the identification of functional elements on the newly assembled genome, a process called genome annotation.
18.8K
Positron Emission Tomography
4.0K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.0K
Genomics
35.7K
Genomics is the science of genomes: it is the study of all the genetic material of an organism. In humans, the genome consists of information carried in 23 pairs of chromosomes in the nucleus, as well as mitochondrial DNA. In genomics, both coding and non-coding DNA is sequenced and analyzed. Genomics allows a better understanding of all living things, their evolution, and their diversity. It has a myriad of uses: for example, to build phylogenetic trees, to improve productivity and...
35.7K


