属性提示器:通过视觉语言预训练模型,通过属性语义自动提示,通过视觉语言预训练模型进行零射击核检测
IEEE transactions on medical imaging
|October 3, 2024
概括
这项研究探讨使用视觉语言预训练模型 (VLPMs) 在组织病理学图像中进行零射击核检测. 拟议的AttriPrompter管道和知识蒸框架实现了高精度,优于现有的无监督方法.
科学领域:
- 计算病理学计算病理学
- 医疗图像分析 医学图像分析
- 医学中的人工智能
背景情况:
- 预先训练有素的视觉语言模型 (VLPMs) 在自然场景中擅长对象检测.
- 将VLPM应用于组织病理学,以检测零射击核,由于域差异,因此具有挑战性.
- 现有的方法缺乏用于自动化快速生成和处理密集核的有效策略.
研究的目的:
- 调查基于语言图像预训练 (GLIP) 模型在零射击核检测方面的有效性.
- 介绍AttriPrompter,这是一个用于生成语义丰富文本提示的自动管道,用于核检测.
- 开发一个自我训练的知识蒸框架,以应对诸如高核密度和重叠实例等挑战.
主要方法:
- 开发了AttriPrompter用于属性生成,增强和相关性排序,以创建文本提示.
- 使用GLIP,生成提示,用于初始零射击核的检测.
- 实施了一种自我训练的知识蒸框架,使用GLIP预测作为伪标签.
主要成果:
- 拟议的方法在无标签核检测方面表现出色.
- 超越了所有现有的无监督核检测方法.
- 展示了出色的概括性和医疗成像任务的潜力.
结论:
- 对自然数据进行预先培训的VLPM对医学成像应用具有重大潜力.
- AttriPrompter提供了一种有效的,自动化的方法,用于提示核检测的工程.
- 知识蒸框架成功地减轻了与密集和重叠的核相关的挑战.
相关概念视频
Light Acquisition
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
Improving Translational Accuracy
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
Atomic Nuclei: Nuclear Spin State Overview
NMR-active nuclei have energy levels called 'spin states' that are associated with the orientations of their nuclear magnetic moments. In the absence of a magnetic field, the nuclear magnetic moments are randomly oriented, and the spin states are degenerate. When an external magnetic field is applied, the spin states have only 2 + 1 orientations available to them. A proton with = ½ has two available orientations. Similarly, for a quadrupolar nucleus with a nuclear spin value of one, the...
Improving Translational Accuracy
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
Positron Emission Tomography
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body being...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body being...
Insensitive Nuclei Enhanced by Polarization Transfer (INEPT)
Insensitive Nuclei Enhanced by Polarization Transfer (INEPT) is an advanced Nuclear Magnetic Resonance (NMR) technique specifically designed to detect and enhance the signals of low-abundance nuclei, such as carbon-13 and nitrogen-15, in small molecules. The fundamental principle behind INEPT is the transfer of polarization from a more abundant and highly polarizable nucleus, typically hydrogen-1, to the low-abundance nucleus of interest. This process effectively boosts the NMR signal of the...


