MKCL:医学知识与对比学习模型用于放射学报告生成
Xiaodi Hou1, Zhi Liu1, Xiaobo Li1
1School of Information Science and Technology, Dalian Maritime University, Dalian 116026, Liaoning, China.
Journal of biomedical informatics
|September 13, 2023
概括
这项研究引入了一种新的医学知识与对比学习 (MKCL) 模型,以改进自动放射学报告生成. 通过整合医学知识图表和对比学习,MKCL提高了准确性,解决了放射学中的数据偏差和未标记图像.
科学领域:
- 人工智能的人工智能
- 医学成像分析 医学成像分析
- 自然语言处理自然语言处理.
背景情况:
- 自动生成放射学报告旨在提高诊断准确性和效率.
- 目前的深度学习方法与视觉文本数据偏差以及缺乏医学知识整合的缺乏斗争.
- 没有标记的医学图像和医学发现的相互作用带来了重大挑战.
研究的目的:
- 提出一种医学知识与对比学习 (MKCL) 模型,用于增强自动放射学报告的生成.
- 解决数据偏差和利用未标记的医疗图像,以提高准确性.
- 整合医疗知识和视觉特征,以便更精确地发现疾病.
主要方法:
- 开发了MKCL模型,将IU医学知识图 (IU-MKG) 纳入其中,以了解医学发现之间的关系.
- 设计了知识增强注意力 (KEA) 来整合IU-MKG与视觉特征,减轻文本数据偏差.
- 员工监督对比学习,有效地利用未标记的X光图像来检测异常.
主要成果:
- 在IU X射线数据集上,MKCL模型在与最先进的方法相比显示出更高的性能.
- 废弃性研究证实了IU-MKG和监督对比学习模块的重要贡献.
- 该模型显示了在检测异常区域和准确描述发现的增强能力.
结论:
- 拟议的MKCL模型通过整合医学知识和对比学习,有效地增强了自动放射学报告的生成.
- KEA和监督对比学习是提高准确性和处理数据限制的关键组成部分.
- MKCL提供了一种有前途的方法来减少放射科医生的工作量并提高医疗保健的效率.
相关概念视频
Radiological Investigation I: X-ray and CT
278
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
278
X-ray Imaging
5.6K
German physicist Wilhelm Röntgen (1845–1923) was experimenting with electrical current when he discovered that a mysterious and invisible "ray" would pass through his flesh but leave an outline of his bones on a screen coated with a metal compound. In 1895, Röntgen made the first durable record of the internal parts of a living human: an "X-ray" image (as it came to be called) of his wife’s hand. Scientists worldwide quickly began their own experiments with...
5.6K
Computed Tomography
4.6K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
4.6K
Radiological Investigation II: MRI and Ventilation Perfusion Scan
148
Description
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
148
Positron Emission Tomography
4.3K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.3K
Imaging Studies III: Computed Tomography
26
DefinitionComputed Tomography (CT) of the genitourinary (GU) tract is a non-invasive imaging modality that utilizes X-rays and computer processing to generate detailed cross-sectional images of the urinary system, encompassing the kidneys, ureters, bladder, and adjacent structures such as the adrenal glands.PurposeCT scans of the GU tract serve several diagnostic and therapeutic purposes, including:Diagnosis of Urinary Tract Diseases: Detects kidney stones, tumors, cysts, and congenital...
26


