跨级多实例蒸用于自主监督的细粒度视觉分类
概括
本研究介绍了跨级多实例蒸 (CMD),以改善细粒度视觉类别的自我监督学习. CMD通过专注于关键图像补丁来增强表示,优于现有方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 精细的视觉类别的高质量的注释需要广泛的专业知识,证明耗时且昂贵.
- 现有的自主监督学习方法由于无关阶级,补丁级嵌入,忽略了关键图像区域,因此与细粒度的视觉表示作斗争.
研究的目的:
- 为了解决目前对细粒度视觉类别的自我监督学习的局限性.
- 提出一个新的框架,跨层次多实例蒸 (CMD),有效地利用信息图像补丁来改善表示学习.
主要方法:
- 拟议的跨级多实例蒸 (CMD) 框架利用多实例学习来识别和加权重要的图像补丁.
- CMD在区域/图像作物对上采用了内部层次 (教师/学生网络内) 和层次间 (教师和学生网络之间) 的多实例知识蒸.
- 这种方法全面学习信息补丁和细粒度语义信息之间的关系.
主要成果:
- 对CUB-200-2011,斯坦福汽车和FGVC飞机数据集的实验显示了显著的性能改进.
- 与当代方法相比,CMD方法实现了高达10.14%的top-1精度和Rank-1检索.
- CMD超过了最先进的自我监督学习方法高达19.78%.
结论:
- 跨层次多实例蒸 (CMD) 提供了一种卓越的方法,用于对细粒度视觉表示的自我监督学习.
- 该框架通过专注于歧视性形象区域,有效地解决了无阶级代表的挑战.
- CMD表现出强大的性能增长,使其成为细粒度视觉识别任务的有希望的解决方案.
相关概念视频
01:29Aggregates Classification
297
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
297
01:31Classification of Systems-II
132
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
132
01:11How Data are Classified: Categorical Data
31.5K
A variable, usually notated by capital letters such as X and Y, is a characteristic or measurement that can be determined for each member of a population. Data are the actual values of variables. They may be numbers, or they may be words. Datum is a single value.
Data are classified based on whether they are measurable or not. Categorical data cannot be measured; instead, it can be divided into categories. For example, if Y denotes a person's party affiliation, some examples of Y include...
Data are classified based on whether they are measurable or not. Categorical data cannot be measured; instead, it can be divided into categories. For example, if Y denotes a person's party affiliation, some examples of Y include...
31.5K
01:26Classification of Systems-I
167
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
167
01:24Generalization, Discrimination, and Extinction
383
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
383
01:22Force Classification
1.1K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.1K