MegaSeg: 针对兆像素图像进行可扩展的语义细分
Solomon Kefas Kaura1, Jialun Wu2, Zeyu Gao3
1School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, 710049, China; Shaanxi Provincial Key Laboratory of Big Data Knowledge Engineering, Xi'an Jiaotong University, Xi'an, 710049, China.
MegaSeg使用新的流媒体U-Net架构高效地细分大型组织病理图像. 这个框架保留了关键的本地细节和全球上下文,克服了用于兆像素图像分析的GPU内存限制.
科学领域:
- 医疗图像分析 医学图像分析
- 计算病理学计算病理学
- 对于组织病理学的深度学习.
背景情况:
- 兆像素图像细分对于高分辨率的组织病理学分析至关重要.
- 当前的GPU内存限制需要补丁和降低样本,从而损害了上下文信息.
- 对大格式图像的高效细分仍然是一个重大挑战.
研究的目的:
- 介绍MegaSeg,这是一个端到端的框架,用于兆像素基因病理图像的语义细分.
- 在不牺牲细节或上下文的情况下,能够有效处理大型图像 (例如,8192×8192像素).
- 在高分辨率图像分析中减少内存使用.
主要方法:
- 开发了MegaSeg,这是一个端到端的框架,利用流动卷积网络在U形架构中.
- 在处理大型图像时,实施了分裂与征服策略.
- 在解码路径内提出了注意密集精制模块 (ADRM),以增强本地细节和上下文信息.
主要成果:
- MegaSeg能够高效地对67MP图像进行语义细分,同时保留全球结构和本地细节.
- 在公共基因病理学数据集上表现出卓越的性能.
- 在CAMELYON16数据集上,在将输入大小从4MP扩大到67MP时,自由响应操作特征 (FROC) 评分从0.78到0.89显著改善.
结论:
- MegaSeg有效地克服了用于兆像素图像分割的GPU内存限制.
- 该框架以高分辨率的基因病理学图像保存了基本的全球和本地上下文信息.
- MegaSeg为大规模医疗图像分析提供了一个有前途的解决方案,增强了诊断能力.
相关概念视频
08:17A Semantic Priming Event-related Potential (ERP) Task to Study Lexico-semantic and Visuo-semantic Processing in Autism Spectrum Disorder
Language: The N400 in Semantic Incongruity
Understanding language is one of the most complex cognitive tasks that humans are capable of. Given the incredible amount of possible choices when combining individual words to form meaning in sentences, it is crucial that the brain is able to identify when words form coherent combinations and when an anomaly appears that undermines meaning. Extensive research has shown that certain...
05:38Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
11:03High-resolution In Vivo Manual Segmentation Protocol for Human Hippocampal Subfields Using 3T Magnetic Resonance Imaging
10:39A Label-Free Segmentation Approach for Intravital Imaging of Mammary Tumor Microenvironment
06:48Automated Segmentation of Cortical Grey Matter from T1-Weighted MRI Images

