PMG-SAM:通过面具前指导来促进SAM的自动细分.
Jixue Gao1, Xiaoyan Jiang1, Anjie Wang2
1School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, China.
Sensors (Basel, Switzerland)
|January 28, 2026
概括
我们介绍了PMG-SAM,这是一个新的框架,增强了自动对象细分. 我们的前面具指导方法克服了诸如分段任何模型 (SAM) 等现有模型的局限性,在具有挑战性的图像分割任务中提高了准确性.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 像Segment Anything Model (SAM) 这样的基础视觉模型在全自动,有针对性的对象细分方面面临着挑战.
- SAM的"分割一切"模式表现出局部失明和计算效率低下,阻碍了诸如二元图像分割 (DIS) 等任务的性能.
研究的目的:
- 开发一个高效和准确的框架,PMG-SAM,用于自动定向对象细分.
- 为了解决本地化瓶问题,大型视觉模型用于无提示分段场景.
主要方法:
- 拟议的PMG-SAM框架使用前面具导向范式进行自动定向细分.
- 采用双分支编码器生成全局的Pre-Mask,作为分段解码器的内部提示.
- 引入了密度残留融合模块 (DRFM) 进行代,多尺度的特征共同精炼,以提高前面膜质量.
主要成果:
- 在具有挑战性的DIS和伪装对象分割 (COS) 任务上,PMG-SAM显著提高了性能.
- 在DIS-TE2基准上达到0.815的最大F-测量值,比SAM的0.283.3大幅增加.
- 超越了SAM和SAM2在地面真相界限框提示模式中的表现,尽管它是完全自动的,并且使用的可训练参数较少 (22.9M).
结论:
- PMG-SAM为自动目标对象细分提供了有效和高效的解决方案.
- 前面罩引导范式成功克服了在没有提示的设置中大型视觉模型的本地化限制.
- 这一框架为推进计算机视觉中的无提示分段能力提供了一个有希望的方向.
相关概念视频
Masking and Demasking Agents
3.6K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
3.6K
Administering Oxygen by Mask
2.3K
Administering Oxygen by Mask
Administering oxygen by mask is a common nursing intervention that provides supplemental oxygen to patients with respiratory distress or chronic lung conditions. This procedure involves delivering oxygen at a specified rate through a face mask connected to an oxygen source.
Equipment
The equipment necessary for this procedure includes:
Administering oxygen by mask is a common nursing intervention that provides supplemental oxygen to patients with respiratory distress or chronic lung conditions. This procedure involves delivering oxygen at a specified rate through a face mask connected to an oxygen source.
Equipment
The equipment necessary for this procedure includes:
2.3K
pre-mRNA Processing
57.4K
In eukaryotic cells, transcripts made by RNA polymerase are modified and processed before exiting the nucleus. Unprocessed RNA is called precursor mRNA or pre-mRNA to distinguish it from mature mRNA.
Once about 20-40 ribonucleotides have been joined together by RNA polymerase, a group of enzymes adds a “cap” to the 5’ end of the growing transcript. In this process, a 5’ phosphate is replaced by modified guanosine that has a methyl group attached to it (7-Methyl...
Once about 20-40 ribonucleotides have been joined together by RNA polymerase, a group of enzymes adds a “cap” to the 5’ end of the growing transcript. In this process, a 5’ phosphate is replaced by modified guanosine that has a methyl group attached to it (7-Methyl...
57.4K
Oxygen Delivering System I: Nasal Cannula and Face Mask
1.6K
The human body requires oxygen to function, and when the natural process of respiration is hindered, external devices, including the following, are needed to help deliver this vital gas.
Nasal Cannula
A nasal cannula is a lightweight tube split at one end into two prongs and placed in the nostrils. It is typically used to deliver low to medium levels of oxygen.
Suggested flow rate: The suggested flow rate for a nasal cannula typically ranges between 1 and 6 L/min.
Oxygen percentage setting:...
Nasal Cannula
A nasal cannula is a lightweight tube split at one end into two prongs and placed in the nostrils. It is typically used to deliver low to medium levels of oxygen.
Suggested flow rate: The suggested flow rate for a nasal cannula typically ranges between 1 and 6 L/min.
Oxygen percentage setting:...
1.6K
Pre-mRNA Processing: Modification of pre-mRNA Ends
14.8K
In eukaryotic cells, transcripts made by RNA polymerase are modified and processed before exiting the nucleus. Unprocessed RNA is called precursor mRNA or pre-mRNA to distinguish it from mature mRNA.
Once about 20-40 ribonucleotides have been joined together by RNA polymerase, a group of enzymes adds a cap to the 5' end of the growing transcript. In this process, a 5' phosphate is replaced by modified guanosine that has a methyl group attached (7-methyl guanosine). This 5' cap helps...
Once about 20-40 ribonucleotides have been joined together by RNA polymerase, a group of enzymes adds a cap to the 5' end of the growing transcript. In this process, a 5' phosphate is replaced by modified guanosine that has a methyl group attached (7-methyl guanosine). This 5' cap helps...
14.8K
Oxygen Delivering System II: Venturi Mask and Transtracheal Oxygen
2.2K
Oxygen therapy is a pivotal aspect of medical care, particularly for patients with respiratory ailments. Two prominent oxygen-delivering systems include the Venturi mask and the transtracheal oxygen catheter.
Venturi Mask
The Venturi mask, named after the Venturi effect, is designed to deliver precise oxygen concentrations. It consists of a large tube with an oxygen inlet that narrows down, causing a pressure drop that pulls air in through adjustable side ports. The mask is a lightweight,...
Venturi Mask
The Venturi mask, named after the Venturi effect, is designed to deliver precise oxygen concentrations. It consists of a large tube with an oxygen inlet that narrows down, causing a pressure drop that pulls air in through adjustable side ports. The mask is a lightweight,...
2.2K


