相关实验视频

Updated: Jul 9, 2025

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Published on: October 27, 2023

用医学知识和多层次图像报告对齐生成放射学报告:一种新方法及其验证

Guosheng Zhao¹, Zijian Zhao¹, Wuxian Gong²

¹School of Control Science and Engineering, Shandong University, Jinan, 250061, China.

Artificial intelligence in medicine

|December 2, 2023

概括

这项研究引入了一种新的方法,通过增强知识和对齐图像-文本数据来生成医疗报告. 这种方法提高了诊断准确度,并通过解决数据偏差和结合医学知识来减少放射科医生的工作量.

科学领域:

人工智能的人工智能
医疗信息学医疗信息学
放射学放射学是一门学科.

背景情况:

医疗报告生成对于计算机辅助诊断至关重要,有助于放射科医生和医生.
现有的模型在长时间报告序列,数据偏差和缺乏医疗知识整合方面扎.
当前的方法往往忽略了医疗图像及其相应报告之间的关键相互作用对齐.

研究的目的:

提出一种新的方法,即知识增强与多层面对齐 (MKMIA),以改善医疗报告的生成.
解决现有模型的局限性,包括数据偏差和医疗知识不足.
加强医疗图像和文本报告之间的协调,以便更准确,更全面地生成报告.

主要方法:

开发了一个知识增强 (MKE) 模块,结合了一般医学知识 (MK) 和历史知识 (HK).
实现了一个多层次对齐 (MIRA) 模块,用于图像和文本特征之间的粗细对齐.
使用基于字典的方法来获得一般医学知识,包括器官别名和疾病症状,以减轻数据偏差.
利用历史知识进行比较病例分析,以提高诊断准确度.

主要成果:

采用MKMIA方法在医疗报告生成方面取得了显著的改善.
该MKE模块有效地减轻了数据偏差,并整合了相关的医学知识.
该MIRA模块增强了功能对齐,促进了长期和准确的报告的生成.
在IU X射线和MIMIC-CXR放射学报告数据集上实现了最先进的性能.

结论:

拟议的MKMIA方法通过整合知识和改进图像-文本对齐,有效地提高了医疗报告的生成.
这种方法在减少放射科医生的工作量和最大限度地降低误诊风险方面表现有希望.
这些发现强调了知识增强和医疗人工智能应用中的多层次对齐的重要性.

关键词:

编码器解码器增强知识增强知识医疗报告的生成医学报告的生成多层次对齐方式的多层次对齐专注于自己的注意力

更多相关视频

Guidelines and Experience Using Imaging Biomarker Explorer IBEX for Radiomics

Guidelines and Experience Using Imaging Biomarker Explorer IBEX for Radiomics

Published on: January 8, 2018

Combining Reflectance Confocal Microscopy with Optical Coherence Tomography for Noninvasive Diagnosis of Skin Cancers via Image Acquisition

Combining Reflectance Confocal Microscopy with Optical Coherence Tomography for Noninvasive Diagnosis of Skin Cancers via Image Acquisition

Published on: August 18, 2022

相关概念视频

Magnetic Resonance Imaging

Magnetic Resonance Imaging

Magnetic resonance imaging (MRI) is a noninvasive medical imaging technique based on a phenomenon of nuclear physics discovered in the 1930s, in which matter exposed to magnetic fields and radio waves was found to emit radio signals. In 1970, a physician and researcher named Raymond Damadian noticed that malignant (cancerous) tissue gave off different signals than normal body tissue. He applied for a patent for the first MRI scanning device in clinical use by the early 1980s. The early MRI...

Positron Emission Tomography

Positron Emission Tomography

Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...

Radiological Investigation I: X-ray and CT

Radiological Investigation I: X-ray and CT

Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...

X-ray Imaging

X-ray Imaging

German physicist Wilhelm Röntgen (1845–1923) was experimenting with electrical current when he discovered that a mysterious and invisible "ray" would pass through his flesh but leave an outline of his bones on a screen coated with a metal compound. In 1895, Röntgen made the first durable record of the internal parts of a living human: an "X-ray" image (as it came to be called) of his wife’s hand. Scientists worldwide quickly began their own experiments with...