HGCMorph:通过GNN和可变形医疗图像注册囊网络进行联合不连续性保护和姿势学习
Zhiyue Yan1, Jianhua Ji1, Jia Ma2
1State Key Laboratory of Radio Frequency Heterogeneous Integration, Shenzhen University, Shenzhen 518060, Guangdong Province, People's Republic of China.
Physics in medicine and biology
|February 19, 2024
概括
这项研究介绍了HGCMorph,这是一种结合ConvNets,图形神经网络 (GNN) 和囊网络的新型深度学习模型,用于卓越的医疗图像注册,在精度和处理复杂旋转方面表现出色.
科学领域:
- 医疗成像医学成像
- 人工智能的人工智能
- 计算机视觉 计算机视觉
背景情况:
- 现有的医疗图像注册方法在准确性和处理复杂的转换方面存在困难.
- 像U-Net,ConvNets和Transformers这样的深度学习模型在捕捉复杂的空间关系方面存在局限性.
研究的目的:
- 开发一种新的深度学习架构,HGCMorph,用于增强医疗图像注册.
- 为了提高准确性,效率和旋转注册能力.
- 集成ConvNets,GNNs和囊网络,以提供全面的特征表示.
主要方法:
- HGCMorph使用混合框架,集成ConvNets和GNNs,用于局部特征提取和短距离注意.
- 囊网络 (CapsNets) 用于模拟抽象的,更高层次的特征,如方向和变形.
- 该方法支持无监督和半监督的学习模式.
主要成果:
- 在无监督注册中,HGCMorph显著优于TransMorph等最先进的方法,在子得分系数 (DSC) 中增加了7%/38%.
- 该模型在半监督的设置中展示了改进的注册准确性,以及在复杂的3D旋转和变形时的强大性能.
- 在各种数据集上成功验证,包括OASIS,LPBA40和肺成像数据集.
结论:
- HGCMorph为医疗图像注册提供了一个创新的框架,克服了现有方法的局限性.
- 混合架构有效地捕捉了本地和抽象特征,提高了注册准确性和不连续性保护.
- 这种方法代表了一项重大进步,有可能改善依赖精确图像记录的各种医疗应用.
相关概念视频
01:13Dense Connective Tissue
7.7K
Dense connective tissue contains more collagen fibers than loose connective tissue. As a consequence, it displays greater resistance to stretching. There are two major categories of dense connective tissue— regular and irregular.
Dense Regular Connective Tissue
In dense regular connective tissue, fibers are arranged parallel to each other, enhancing its tensile strength and resistance to stretching in the direction of the fiber orientations. Ligaments and tendons are made of dense regular...
Dense Regular Connective Tissue
In dense regular connective tissue, fibers are arranged parallel to each other, enhancing its tensile strength and resistance to stretching in the direction of the fiber orientations. Ligaments and tendons are made of dense regular...
7.7K
01:14Imaging Studies I: CT and MRI
242
Introduction: MRI and CT scans are crucial advancements in medical imaging techniques, playing a vital role in diagnosing conditions related to the gastrointestinal (GI) system. Each scan serves distinct purposes, targets specific areas, and requires unique nursing duties.
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
242
01:10Computed Tomography
4.5K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
4.5K