XBusNet:通过多式视觉语言学习的方式进行文本引导的乳房超声波细分
1Department of Computer Science, University of Nevada, Las Vegas, NV 89154, USA.
Diagnostics (Basel, Switzerland)
|November 27, 2025
概括
通过将图像分析与文本提示相结合,XBusNet改善了乳房超声波 (US) 病变细分,提高了小或低对比度病变的准确性.
科学领域:
- 医疗成像医学成像
- 人工智能在医学中的应用
- 生物医学工程 生物医学工程
背景情况:
- 精确的乳房超声波 (BUS) 分段对于精确的损伤测量和分析至关重要.
- 在BUS细分方面的挑战包括小病变,低对比度,模糊边缘和斑点噪声.
- 当前的方法在使用文本图像线索时,难以处理细微的边界细节.
研究的目的:
- 开发一种新的多式模式模型,XBusNet,用于精确的乳房超声波病变细分.
- 从文本提示与图像特征集成临床上下文,以改善细分.
- 为了提高对细分具有挑战性的小和低对比度病变的稳定性.
主要方法:
- 提出XBusNet,一个双提示符,双分支多式模式.
- 采用全球通道 (CLIP视觉转换器) 进行图像语义和本地U-Net通道进行边界精度.
- 利用描述病变特征 (形状,边缘,BI-RADS) 的自动组装文本提示来调节本地途径.
主要成果:
- 在乳腺损伤USG (BLU) 数据集上,XBusNet实现了最先进的性能.
- 获得了0.8766的平均子得分和0.8150.0的交叉与联盟 (IoU) 的平均得分.
- 对小病变显著改善,减少错过的区域和虚假激活.
结论:
- 双提示,双分支多式联络设计有效地融合了全球语义和本地精度.
- XBusNet产生了精确的BUS细分面具,提高了对具有挑战性的损伤的稳定性.
- 这种方法提高了乳房超声波定量分析和下游分类的可靠性.
相关概念视频
01:20Ultrasound I: Abdominal Ultrasonography
Introduction:
Abdominal ultrasonography, commonly known as abdominal ultrasound, is a vital, non-invasive medical imaging technique widely used in healthcare.
Procedure:
This diagnostic tool allows the clinician to visually inspect internal structures within the abdomen, including vital organs such as the liver, gallbladder, pancreas, kidneys, and spleen.
The abdominal ultrasound process begins with applying a special gel to the patient's skin over the abdomen. This gel enhances the...
Abdominal ultrasonography, commonly known as abdominal ultrasound, is a vital, non-invasive medical imaging technique widely used in healthcare.
Procedure:
This diagnostic tool allows the clinician to visually inspect internal structures within the abdomen, including vital organs such as the liver, gallbladder, pancreas, kidneys, and spleen.
The abdominal ultrasound process begins with applying a special gel to the patient's skin over the abdomen. This gel enhances the...
01:20Imaging Studies for Cardiovascular System II:Types of Echocardiography
Echocardiography plays a role in assessing cardiac health and detecting heart conditions, with various types providing critical insights for diagnosis and treatment.
Types of Echocardiography
Transthoracic Echocardiography (TTE)
TTE is the most common type of echocardiogram which involves placing a transducer on the patient's chest, emitting sound waves to create heart images. TTE is invaluable for evaluating the heart's size, structure, and motion, making it particularly useful for diagnosing...
Types of Echocardiography
Transthoracic Echocardiography (TTE)
TTE is the most common type of echocardiogram which involves placing a transducer on the patient's chest, emitting sound waves to create heart images. TTE is invaluable for evaluating the heart's size, structure, and motion, making it particularly useful for diagnosing...
01:22Imaging Studies VI: Voiding Cystourethrography and Cystography
Voiding Cystourethrography (VCUG) and Cystography are specialized radiographic procedures used to examine the structure and function of the bladder and urethra.Voiding Cystourethrography (VCUG)A Voiding Cystourethrogram (VCUG) is a diagnostic imaging procedure that assesses the anatomy and function of the lower urinary tract. It focuses on the bladder, bladder neck, and urethra, helping detect abnormalities such as vesicoureteral reflux (VUR)—the backward or reverse flow of urine into the...