双关联变压器网络 (DRTN):具有特征删除和对比学习的双关联变压器网络,用于多标签图像分类
Wei Zhou1, Kang Lin1, Zhijie Zheng1
1School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510006, Guangdong, China.
概括
双关系变压器网络 (DRTN) 通过保存空间信息和增强特征学习来改善多标签图像分类. 这种新的方法超越了对基准数据集的现有模型.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 多标签图像分类 (MLIC) 旨在识别图像中的多个对象.
- 现有的基于变压器的方法使二维特征地图变平,失去空间信息.
- 当前的注意力模型可能忽略了MLIC潜在的有用特征.
研究的目的:
- 引入一种新的双关系变压器网络 (DRTN),用于端到端的多标签图像分类.
- 为了解决基于变压器的MLIC方法中的空间信息丢失问题.
- 加强对MLIC的区分和全面特征的学习.
主要方法:
- 一个网格聚合方案产生伪区域特征来恢复空间信息.
- 双关系增强 (DRE) 模块使用双视觉特征捕捉对象相关性.
- 一个功能增强和删除 (FEE) 模块挖掘了歧视性和潜在的功能.
- 一个对比学习 (CL) 模块通过区分前景和背景特征来完善特征学习.
主要成果:
- 与当前的MLIC模型相比,DRTN方法实现了更高的性能.
- 在具有挑战性的基准上进行了实验:MS-COCO 2014,PASCAL VOC 2007和NUS-WIDE.
- 拟议的模块有效地弥补了丢失的空间信息,并加强了特征歧视.
结论:
- DRTN为多标签图像分类提供了一个强大的解决方案.
- 电网聚合,DRE,FEE和CL模块的集成导致了全面的功能学习.
- 据报道,DRTN在已建立的MLIC基准指标上取得了显著改善.
相关概念视频
Classification of Systems-II
133
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
133
Associative Learning
275
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
275
Multi-input and Multi-variable systems
93
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
93
Classification of Systems-I
167
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
167
Generalization, Discrimination, and Extinction
392
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
392
Types Of Transformers
943
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
943


