WEViT:重量纠的视觉转换器,对弱监督的语义细分进行类别特定的关注,用于弱监督的语义细分
Narges Saeedizadeh1, Seyed Mohammad Jafar Jalali2, Burhan Khan1
1Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia.
概括
本研究介绍WEViT,这是一个新的框架,将神经架构搜索 (NAS) 与弱监督语义分割 (WSSS) 变压器集成在一起. WEViT优化网络架构以实现准确的对象本地化,实现最先进的结果.
科学领域:
- 计算机视觉 计算机视觉
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 弱监督语义细分 (WSSS) 传统上使用类激活地图 (CAM),但在平衡本地化准确性和可扩展性方面面临挑战.
- 现有的方法通常依赖于固定网络架构和手动策略,限制了适应性.
- 由于需要有效的重量分配,神经架构搜索 (NAS) 尚未应用于WSSS.
研究的目的:
- 提出WEViT,一个新的框架,将NAS与WSSS的变压器相结合.
- 优化网络架构以生成准确的,类特定的对象本地化地图.
- 通过提高可扩展性和效率来解决传统WSSS方法的局限性.
主要方法:
- WEViT将NAS与变压器集成,利用重量纠策略进行高效的超级网络训练和重量继承.
- 一个进化算法选择了最佳的架构,从中提取变压器头的注意力权重.
- 使用精细化补丁关联策略和正规化损失函数来提高本地化准确性和阶级歧视.
主要成果:
- 在PASCAL VOC 2012和MS COCO等基准数据集上,WEViT实现了最先进的性能.
- 该框架首次证明了将NAS应用于WSSS的有效性.
- 重量纠策略通过避免子网重新训练,显著降低了计算成本.
结论:
- WEViT提供了一个可扩展,高效和准确的解决方案,用于弱监督的语义细分.
- 纳斯和变压器的集成是WSSS的一个重大进步.
- 这项工作为优化细分任务中的深度学习架构开辟了新的途径.
相关概念视频
Weighted Mean
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
Types Of Transformers
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
Classification of Neurotransmitters
Neurotransmitters play a crucial role in the communication between neurons in the autonomic nervous system. Neurons in the autonomic nervous system can be cholinergic or adrenergic depending on the neurotransmitters synthesized. Cholinergic neurons use acetylcholine as their primary neurotransmitter. This includes all the preganglionic fibers of the sympathetic and pre- and postganglionic fibers of the parasympathetic nervous systems. In addition, neurons of the somatic nervous system also use...
Classification of Titrimetric Analysis Based on Reaction Types
Titrimetric analysis in solution chemistry involves measuring the volume of solutions and is often called volumetric analysis. The standard solution of known concentration in the burette is called the titrant, whereas the solution of unknown concentration in the flask is called the analyte, or titrand. Titrimetric analyses can be classified into four types based on the reactions between the titrant and analyte.
Titrations between an acid and a base lead to neutralization reactions that form...
Titrations between an acid and a base lead to neutralization reactions that form...
Insensitive Nuclei Enhanced by Polarization Transfer (INEPT)
Insensitive Nuclei Enhanced by Polarization Transfer (INEPT) is an advanced Nuclear Magnetic Resonance (NMR) technique specifically designed to detect and enhance the signals of low-abundance nuclei, such as carbon-13 and nitrogen-15, in small molecules. The fundamental principle behind INEPT is the transfer of polarization from a more abundant and highly polarizable nucleus, typically hydrogen-1, to the low-abundance nucleus of interest. This process effectively boosts the NMR signal of the...
Aggregates Classification
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...

