一个适应性和轻量级的YOLOv5检测模型用于PET/CT图像中的肺癌
Tao Zhou1,2, Xinyu Ye3,4, Huiling Lu5
1School of Computer Science and Engineering, North Minzu University, Yinchuan, 750021, China.
Scientific reports
|December 27, 2024
概括
一种新的交叉模式YOLOv5 (CMYOLOv5) 模型通过融合多模态PET和CT图像来增强肺癌检测. 与现有方法相比,这种方法显著提高了不规则瘤的准确性和特征表示.
科学领域:
- 医疗成像医学成像
- 人工智能的人工智能
- 在瘤学瘤学.
背景情况:
- 多模式医学图像对于准确检测瘤病变至关重要.
- 目前的模型通常依赖于单一的成像模式,限制了对病变特征如形状,大小和对比度的全面理解.
- 需要模型可以有效地整合来自多个来源的语义信息.
研究的目的:
- 为改进多模式肺瘤检测提出交叉模式YOLOv5 (CMYOLOv5) 模型.
- 加强来自PET和CT扫描的互补信息的融合.
- 为了提高不规则的肺瘤的特征表示能力.
主要方法:
- 开发了用于PET和CT语义提取的双分支辅助网络.
- 实现跨模态特征融合 (CFF) 和自适应注意力融合 (AAF) 以集成多模态数据.
- 使用自适应式变压器 (SAT) 在功能增强部具有可变形的注意力.
- 集成的修复参数剩余块 (RRB) 和修复参数卷积 (RC) 进行更丰富的特征学习.
主要成果:
- CMYOLOv5实现了高性能指标:97.16%的精度,96.41%的回忆,97.18%的mAP和96.78%的F1得分.
- 该模型显示,不规则的肺瘤的检测精度更高.
- 实现了96.37的处理速度 (FPS),训练时间为3912秒.
结论:
- 拟议的CMYOLOv5模型有效地利用多模式PET/CT数据来检测高级肺瘤.
- 集成先进的融合技术和变压器架构增强了模型捕捉复杂的损伤特征的能力.
- 在检测不规则的肺瘤方面,CMYOLOv5的性能优于现有的先进方法.
相关概念视频
01:10Computed Tomography
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
01:29Positron Emission Tomography
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body being...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body being...