多层次的上下文原型调制,用于构成式零射击学习
相关实验视频
Updated: Sep 13, 2025

13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
20.1K
概括
构成式零射击学习 (CZSL) 有效地识别使用新的多级上下文原型调制 (MCPM) 框架的未见的属性-对象组合. MCPM增强了特征歧视,并适应数据不平衡,以提高性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 构成式零射击学习 (CZSL) 面临挑战,因为属性和对象的视觉特征纠在一起,导致分布转移.
- 现有的方法往往忽略了原始的变化和相互作用,导致特征歧视差,并在CZSL中产生偏见的预测.
研究的目的:
- 提出一个新的框架,多级上下文原型调制 (MCPM),以提高组合式零射击学习的性能.
- 解决特征纠问题,并提高特征对象组合的视觉嵌入的可辨别性.
主要方法:
- 开发了一个基于变压器的层次框架 (MCPM) 来整合属性和对象以实现更丰富的视觉嵌入.
- 应用了特征级别的对比学习,以提高可区分性,并引入了一个子类驱动的调制器,用于微细的属性-对象交互.
- 实施了少数属性增强 (MAE) 策略,以合成虚拟样本并减轻数据不平衡.
主要成果:
- 在四个基准数据集 (MIT-States,C-GQA,UT-Zappos,VAW-CZSL) 中,MCPM表现出显著的性能改善.
- 提出的方法有效地改善了特征歧视和适应组成任务中的长尾分布.
- 少数属性增强策略在缓解数据不平衡问题上被证明是有效的.
结论:
- 多级上下文原型调制 (MCPM) 框架为构成式零射击学习提供了一个强大的解决方案.
- MCPM的层次结构和新的策略显著提高了未见的属性对象组合的识别.
- 该研究验证了MCPM在复杂的组成场景中的有效性,特别是处理数据不平衡和特征纠.
更多相关视频
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
684
12:49Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
Published on: July 13, 2019
17.3K
相关概念视频
Concepts and Prototypes
226
The human nervous system handles vast amounts of information by translating sensory stimuli into neural impulses, which the brain processes, creating thoughts expressed through language or stored as memories. The brain also synthesizes information from emotions and memories, which significantly influence thoughts and behaviors. This intricate process creates a comprehensive mental picture.
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
226
Multi-input and Multi-variable systems
150
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
150
Associative Learning
579
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
579
Observational Learning
314
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
314
Generalization, Discrimination, and Extinction
802
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
802
Long-term Potentiation
2.9K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
2.9K