基于胸部X射线图像的疾病诊断的跨模式深度度度度学习模型
Yufei Jin1,2, Huijuan Lu1,2, Zhao Li3
1China JiLiang University, Hangzhou, 310018 Zhejiang China.
概括
这项研究介绍了一种新的跨模态深度度度度学习通用零射击学习 (CM-DML-GZSL) 模型用于医疗图像分析. 该模型使用新的加权损失函数提高了诊断未见疾病的准确性,增强了零射击多标签学习.
科学领域:
- 人工智能的人工智能
- 医疗成像医学成像
- 机器学习 机器学习
背景情况:
- 新出现的疾病通常存在于有限的或没有可用样本进行分析.
- 零射击学习 (ZSL) 和少射击学习 (FSL) 在医学图像分析中显示出潜力,特别是在罕见或未知的疾病中.
- 准确的医学图像分类对于及时诊断和治疗至关重要.
研究的目的:
- 为医疗图像分析提出一种新的跨模态深度度度度学习通用零射击学习 (CM-DML-GZSL) 模型.
- 在零射击学习模型的培训过程中,解决多标签环境中正负不平衡的挑战.
- 通过改善视觉特征和语义向量之间的对应性来提高诊断看不见的疾病的准确性.
主要方法:
- 开发了一个双流网络,包括一个视觉特征提取器,一个固定的语义特征提取器和一个深度回归模块.
- 引入了一种新的加权聚焦的欧几里德距离度量损失函数,以动态调整样本重量.
- 实施了一般化的零射击学习方法,用于医学成像中的多标签分类.
主要成果:
- 拟议的CM-DML-GZSL模型有效地减轻了预测未见类的偏差.
- 权重聚焦的欧几里德距离度量损失函数成功处理正负不平衡,提高准确性.
- 对大型公共数据集的实验结果表明,该模型在零射击多标签学习中对胸部X射线诊断的有效性.
结论:
- CM-DML-GZSL模型在数据有限的情况下为医疗图像分析提供了一个有前途的解决方案.
- 新的加权损失函数显著提高了在多标签医疗图像分类中通用零射击学习的性能.
- 这种方法促进了胸部X射线诊断的零射击多标签学习,为改善诊断能力铺平了道路.
更多相关视频
02:09Multi-modal Pulmonary Imaging: Using Complementary Information from CT and Hyperpolarized 129Xe MRI to Evaluate Lung Structure-Function
Published on: April 12, 2024
641
07:15Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
Published on: August 16, 2020
6.9K
相关概念视频
Imaging Studies for Cardiovascular System III: X-Ray
219
The most common cardiovascular diagnostic test is an X-ray. It produces images of the heart, blood vessels, and adjacent structures.
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
219
Classification of Illness
7.6K
The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
7.6K
Radiological Investigation I: X-ray and CT
298
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
298
X-ray Imaging
5.6K
German physicist Wilhelm Röntgen (1845–1923) was experimenting with electrical current when he discovered that a mysterious and invisible "ray" would pass through his flesh but leave an outline of his bones on a screen coated with a metal compound. In 1895, Röntgen made the first durable record of the internal parts of a living human: an "X-ray" image (as it came to be called) of his wife’s hand. Scientists worldwide quickly began their own experiments with...
5.6K
