跨域视觉提示与空间近距离知识蒸用于组织学图像分类
Xiaohong Li1, Guoheng Huang1, Lianglun Cheng1
1School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, China.
Journal of biomedical informatics
|September 22, 2024
概括
这项研究引入了用于组织学分类的新知识蒸方法,提高了较小模型的准确性. VPSP架构增强了功能提取和域调整,以获得更好的临床应用.
科学领域:
- 计算病理学计算病理学
- 数字组织病理学 数字组织病理学
- 机器学习在医学中的应用
背景情况:
- 组织学分类是复杂的,因为组织变异和模糊的边缘.
- 大型深度学习模型实现了良好的性能,但需要大量的资源和数据.
- 知识蒸 (KD) 可以使较小的模型模仿较大的模型,但与高维特征和边缘关系作斗争.
研究的目的:
- 解决组织学分类中当前知识蒸方法的局限性.
- 为准确的组织学分析开发一种计算效率高的方法.
- 改善人工智能在组织病理学中的实际应用.
主要方法:
- 提出了一种全新的跨领域视觉提示蒸方法.
- 利用教师网络将高维特征提取为学生网络的低维地图.
- 引入了一个动态可学习的温度模块,具有基于矢量的空间近距离,用于增强学生的模仿.
主要成果:
- 在组织学数据集 (NCT-CRC-HE-100K,LC25000) 和皮肤镜数据集 (ISIC-2019) 上证明有效.
- 与最先进的知识蒸方法相比,实现了卓越的性能和稳定性.
- 展示了最佳的域名适应能力.
结论:
- 引入了VPSP,一种专门用于组织学分类的新型蒸架构.
- VPSP实现了卓越的性能和最佳的域调整,提高了临床效用.
- 源代码将公开发布,以促进进一步的研究和应用.
相关概念视频
Vision
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...


