通过学习跨元域的双原型一致性来实现零拍摄图像识别
概括
本研究引入了一个新的框架,即双边指导的原型改进网络 (BPRN),通过弥合语义差距来改善零射击学习 (ZSL). 为了更好地识别未见的类,BPRN完善了双重原型.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 零射击学习 (ZSL) 旨在通过从可见类别转移知识来识别未见的类.
- 现有的ZSL方法由于语义差距,有限的描述符和严格的视觉建模而面临挑战.
- 预定义的类级属性作为基本真相可以阻碍语义与视觉对齐.
研究的目的:
- 提出一个新的ZSL框架,双边指导的原型精制网络 (BPRN),以解决语义差距.
- 改进跨不同尺度的元域的双重原型,以提高ZSL性能.
- 为了实现视觉到语义和语义到视觉模式之间的双向校准.
主要方法:
- 解开类级语义,以生成伪视觉原型.
- 在不同元域的双重原型中利用分布信息进行校准.
- 从精细的双重原型中采用合成的类级别表示,用于推理.
主要成果:
- 在五个基准ZSL数据集上,BPRN表现出竞争性或优异的性能.
- 在一般化零射击学习 (GZSL) 场景中观察到的显著改善:2.1% (AWA1),7.3% (AWA2),6.1% (SUN) 和4.8% (aPY).
- 废除研究和可视化分析证实了BPRN组件的有效性.
结论:
- 拟议的BPRN框架有效地缓解了ZSL中的语义差距.
- 完善双重原型并实现双向校准,可以更好地识别未见的类.
- 在基于嵌入的ZSL方法中,BPRN提供了一个有前途的进步.
相关概念视频
Concepts and Prototypes
511
The human nervous system handles vast amounts of information by translating sensory stimuli into neural impulses, which the brain processes, creating thoughts expressed through language or stored as memories. The brain also synthesizes information from emotions and memories, which significantly influence thoughts and behaviors. This intricate process creates a comprehensive mental picture.
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
511
Associative Learning
1.3K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.3K
Observational Learning
841
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
841
Multi-input and Multi-variable systems
394
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
394
Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K

