TDT-MIL:一个带有双通道空间定位编码器的框架,用于低监督的整个幻灯片图像分类.
Hongbin Zhang1, Ya Feng1, Jin Zhang1
1School of Information and Software Engineering, East China Jiaotong University, China.
Biomedical optics express
|October 18, 2024
概括
本研究介绍了TDT-MIL,这是一个全幻灯片图像 (WSI) 分类的新框架,有效地利用空间位置信息. 该模型在弱监督的分类任务中实现了高精度,优于现有方法.
科学领域:
- 计算病理学计算病理学
- 数字健康数字健康
- 机器学习在医学中的应用
背景情况:
- 全幻灯片图像 (WSI) 分类对于数字病理学至关重要.
- 传统的多个实例学习 (MIL) 往往忽视了WSIs中积极组织之间的空间关系.
- 正确的分类是具有挑战性的,因为在数十亿像素的范围内,正面组织的百分比很小.
研究的目的:
- 提出一个新的框架,TDT-MIL,用于弱监督的WSI分类.
- 解决被忽视的空间位置关系,对于准确的WSI分析至关重要.
- 开发一种能够有效处理不平衡的WSI分类任务的模型.
主要方法:
- 利用卷积神经网络和变压器的串行连接进行特征提取.
- 引入双通道空间位置编码器 (DCSPE) 来捕获本地和全球位置信息.
- 整合了一个卷积式三重注意 (CTA) 模块,以增强跨道信息挖掘.
主要成果:
- 在CAMELYON16和TCGA-NSCLC数据集上实现了高分类准确度和AUC (高达91.54%,94.96%,90.21%,94.36%).
- 在WSI分类中表现优于最先进的基线方法.
- 在不平衡的WSI分类任务上表现满意.
结论:
- TDT-MIL有效地挖掘了WSIs中的病理语义的空间定位和通道间信息.
- 拟议的框架为WSI分类提供了一个可解释但又巧妙的解决方案.
- TDT-MIL显示出在数字病理学中推进弱监督学习的巨大潜力.
相关概念视频
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
Confocal Fluorescence Microscopy
13.1K
Confocal microscopy is an advanced microscopic technique. The prime advantage of the confocal microscope over other microscopy techniques is its ability to block the out-of-focus light from the illuminated samples using pinholes. It is widely used with fluorescence optics to obtain high-resolution, sharp contrast images. Unlike optical microscopes, confocal microscopes use a focused beam of light laser to scan the entire sample surface at different z-planes. These microscopes are, therefore,...
13.1K
Classification of Systems-II
136
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
136
Aggregates Classification
305
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
305
Classification of Systems-I
176
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
176
Depth Perception and Spatial Vision
601
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
601


