属性原型引导的代场景图用于可解释的放射学报告生成
IEEE transactions on medical imaging
|July 8, 2024
概括
这项研究引入了自动化放射学报告生成的新框架,提高了可解释性和关系推理. 属性原型引导的代场景图 (AP-ISG) 增强了解剖区域如何分析,以获得更好的报告.
科学领域:
- 医疗成像中的人工智能
- 放射学报告的生成 放射学报告的生成
- 计算机视觉 计算机视觉
背景情况:
- 自动化放射学报告生成在减少放射科医生工作量方面显示出有前途.
- 使用解剖区域的当前方法提高了解释性,但与关系推理和共享属性作斗争.
研究的目的:
- 提出一种新的框架,即由原型引导的代场景图生成 (AP-ISG),以增强自动化放射学报告生成.
- 通过使用场景图形生成作为辅助任务来提高解释性和关系推理.
主要方法:
- 开发了AP-ISG框架,包括一个代场景图生成 (ISGG) 模块和一个属性原型引导学习 (APL) 模块.
- 对于结构边缘推理和关系推理的上下文化,ISGG使用了一个自回归方案.
- 通过增强原型内部匹配和减少原型间的语义重叠,APL优化了区域之间的属性共同点.
主要成果:
- 在实验中,AP-ISG框架在多个指标上表现出卓越的表现.
- 这种方法有效地将解剖区域之间的共同点归因于模型.
结论:
- 拟议的AP-ISG框架显著推进了自动化放射学报告的生成.
- 整合场景图形生成可以提高医学成像分析中的解释性和关系推理能力.
相关概念视频
Positron Emission Tomography
4.1K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.1K
X-ray Imaging
5.5K
German physicist Wilhelm Röntgen (1845–1923) was experimenting with electrical current when he discovered that a mysterious and invisible "ray" would pass through his flesh but leave an outline of his bones on a screen coated with a metal compound. In 1895, Röntgen made the first durable record of the internal parts of a living human: an "X-ray" image (as it came to be called) of his wife’s hand. Scientists worldwide quickly began their own experiments with...
5.5K
Radiological Investigation I: X-ray and CT
220
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
220
Computed Tomography
4.4K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
4.4K
Imaging Studies II: Positron Emission Tomography and Scintigraphy
105
Positron Emission Tomography (PET) is a medical imaging technique that provides crucial insights into the body's physiological functions at a molecular level. It is an indispensable resource for diagnosing, staging, and monitoring various illnesses, notably cancer, neurological disorders, and cardiovascular conditions.
Fundamental Principles of PET
Fundamental Principles of PET
105
Radiological Investigation III: Pulmonary Angiogram and PET Scan
90
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
90


