一个大型语言模型用于检测放射学报告中的否定表达式
Yvonne Su1, Yonatan B Babore1, Charles E Kahn2,3
1Department of Radiology, Perelman School of Medicine, University of Pennsylvania, 3400 Spruce Street, Philadelphia, 19104, PA, USA.
Journal of imaging informatics in medicine
|September 25, 2024
概括
基于变压器的模型 (CAN-BERT) 与基于规则的系统 (medspaCy) 相比,在放射学报告中显著改善了否定检测. 这一进步增强了用于临床决策和医学研究的数据提取.
科学领域:
- 医疗信息学 医疗信息学
- 自然语言处理自然语言处理.
- 放射学 放射学是一门学科.
背景情况:
- 从非结构化的临床文本中提取准确的信息,对医疗保健至关重要.
- 自然语言处理 (NLP) 系统有助于获得用于临床决策,质量改进和研究的见解.
- 在放射学报告中检测否定概念是具有挑战性的,但对于准确的解释至关重要.
研究的目的:
- 为了比较基于规则的NLP系统 (medspaCy) 和基于变压器的模型 (CAN-BERT) 的性能,用于检测放射学报告中的否定概念.
- 评估两个系统在识别否定术语时的精度,回忆和F1分数.
主要方法:
- 使用了984份未被识别的放射学报告.
- 基于规则的medspaCy系统和临床断言和否定分类双向编码器表示从变压器 (CAN-BERT) 系统进行了比较.
- 2800个随机选择的术语被手动注释为否定,并使用McNemar的测试分析了性能指标.
主要成果:
- 在2800个术语中,13.8%被确定为否定.
- medspaCy实现了0.795的回忆,0.356的精度和0.492.492的F1.
- CAN-BERT实现了0.785的回忆,0.768的精度和0.777的F1,精度明显高于medspaCy (p < 0.001).
结论:
- 基于变压器的CAN-BERT模型在检测放射学报告中的否定术语方面表现出卓越的性能,特别是在精度方面.
- CAN-BERT的高精度和回忆可以改善从文本报告中提取数据.
- 增强的数据提取支持更好的信息检索,人工智能模型培训和在医疗保健中发现因果关系.
相关概念视频
Positron Emission Tomography
4.1K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.1K
Radiological Investigation III: Pulmonary Angiogram and PET Scan
88
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
88
Nonsense-mediated mRNA Decay
10.6K
The Upf proteins that carry out nonsense-mediated decay (NMD) are found in all eukaryotic organisms, including humans. Each protein has an individual role, but they need to work in collaboration. Upf1 is an ATP-dependent RNA helicase that unwinds the RNA helix. Because Upf1 can unwind any RNA, Upf2 and Upf3 are required to help Upf1 discriminate between nonsense and normal mRNAs.
Usually, Upf3 binds to an Exon Junction Complex (EJC) at mRNA splice sites. If a ribosome fully translates the mRNA,...
Usually, Upf3 binds to an Exon Junction Complex (EJC) at mRNA splice sites. If a ribosome fully translates the mRNA,...
10.6K
Magnetic Resonance Imaging
5.0K
Magnetic resonance imaging (MRI) is a noninvasive medical imaging technique based on a phenomenon of nuclear physics discovered in the 1930s, in which matter exposed to magnetic fields and radio waves was found to emit radio signals. In 1970, a physician and researcher named Raymond Damadian noticed that malignant (cancerous) tissue gave off different signals than normal body tissue. He applied for a patent for the first MRI scanning device in clinical use by the early 1980s. The early MRI...
5.0K


