通过基于标签的注意力对比的多标签零射击学习
Shixuan Meng1, Rongxin Jiang1,2, Xiang Tian1,3
1Zhejiang University, Hangzhou, P. R. China.
International journal of neural systems
|January 24, 2025
概括
本研究引入了一种基于标签的对比性注意力 (CLA) 方法,通过减少语义模两可,改善多标签零射击学习 (ML-ZSL). CLA有效地将图像区域与相关标签联系起来,在对象识别任务中表现优于现有的方法.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 多标签零拍摄学习 (ML-ZSL) 旨在识别图像中的所有对象,包括在训练期间没有看到的对象.
- 目前的ML-ZSL方法使用注意力机制,但由于对标签嵌入的平等待遇而存在语义模糊性.
- 这种模糊性阻碍了当多个标签存在时准确的对象识别.
研究的目的:
- 加强在ML-ZSL的注意力机制中对语义信息的利用.
- 提出一种新的方法,以减少标签预测中的语义模糊性.
- 为了提高识别图像中看不见的对象类别的准确性.
主要方法:
- 引入一种基于标签的对比注意力 (CLA) 方法.
- 使用隐藏标签嵌入,CLA将每个标签与最相关的图像区域联系起来.
- 实施区域级对比损失和全球特征对齐模块.
主要成果:
- CLA有效地捕捉了有区别的图像细节,并区分了区域间的相关性.
- 在NUS-WIDE和Open Images基准标准上的实验表明,CLA的表现优于最先进的方法.
- 平均平均精度 (mAP) 的显著改善:在零射击学习设置下,在半岛范围内2.0%和在开放图像中4.0%.
结论:
- 拟议的CLA方法显著减少了ML-ZSL中的语义模两可.
- 在识别看不见的物体类别方面,CLA表现出卓越的性能.
- 这种方法提供了一种更有效,更准确的方式来利用语义信息在注意力机制.
相关概念视频
Associative Learning
285
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
285
Difference from Background: Limit of Detection
5.8K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
5.8K
Nonconscious Mimicry
4.5K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.5K
Multi-input and Multi-variable systems
94
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
94
Generalization, Discrimination, and Extinction
424
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
424


