LuGSAM:一种新的框架,用于将文本提示集成到Segment Anything Model (SAM) 中,用于ICU胸部X射线的细分任务
Dhanush Babu Ramesh1, Rishika Iytha Sridhar2, Pulakesh Upadhyaya3
1Department of Electrical & Computer Engineering, Georgia Institute of Technology, Atlanta, Georgia USA.
在胸部X射线 (CXR) 中,LuGSAM通过使用文本提示和分段任何模型 (SAM) 来增强肺部细分. 这种新的框架可以提高肺部疾病的诊断准确性,而数据需求最小.
科学领域:
- 医疗成像医学成像
- 人工智能在医学中的应用
- 放射学 放射学是一门学科.
背景情况:
- 胸部X射线 (CXR) 中肺部区域的准确细分对于诊断肺部疾病至关重要.
- 当前的细分方法往往需要大量的数据注释或大型数据集,这限制了它们的临床适用性.
研究的目的:
- 为了介绍LuGSAM,一个新的框架集成文本提示与细分任何模型 (SAM) 精确和适应性肺部细分在CXRs.
- 通过减少对大型注释数据集的依赖,克服现有方法的局限性.
主要方法:
- 结合接地DINO,一个使用文字提示的零射击物体探测器,与Meta AI的SAM.
- 使用接地DINO从文本提示生成边界框 (例如"右叶").
- 采用了一种代的界限框调整算法来完善检测并改善SAM的细分面具生成.
主要成果:
- 视觉变压器巨型 (Vit-h) SAM变体在右肺细分方面取得了很高的重叠得分 (IoU = 0.95).
- 接地DINO显示了对"右肺"等提示的高检测准确性 (信心评分=0.58).
- 二元化预测IoU (BPIoU) 指标表明整体细分质量的显著改善.
结论:
- 在临床环境中,LuGSAM为肺部细分提供了一种精确且可适应的方法.
- 该框架利用文本提示和代改进的能力显示了在放射学中推进诊断工具的前景.
- 这种方法减少了对广泛注释的需求,使其成为临床应用的宝贵工具.
更多相关视频
07:53Author Spotlight: Advancing 3D Modeling for Enhanced Diagnosis and Treatment of Pulmonary Nodules in Early-Stage Lung Cancer
Published on: October 13, 2023
02:09Multi-modal Pulmonary Imaging: Using Complementary Information from CT and Hyperpolarized 129Xe MRI to Evaluate Lung Structure-Function
Published on: April 12, 2024
相关概念视频
Assessment of Ventilation II: Respiratory Depth and Rhythm
Respiratory depth measures the volume of air inhaled or exhaled during a breath. It can vary from shallow to deep and typically remains consistent when a person is at rest or asleep. Occasionally, individuals will automatically inhale deeply, known as sighing, which inflates the lungs with more air than normal breathing.
To assess respiratory depth, observe the degree of chest excursion or movement:
Positron Emission Tomography
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body being...
Radiological Investigation II: MRI and Ventilation Perfusion Scan
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Radiological Investigation III: Pulmonary Angiogram and PET Scan
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
