从多个基础模型中提炼知识,用于零拍摄图像分类
1School of Computer Science and Technology, Shandong University of Science and Technology, Qingdao, Shandong, China.
PloS one
|September 20, 2024
概括
本研究引入了一种新的零拍摄图像分类框架,使用基础模型识别未见的类别,而无需额外的训练数据. 该方法实现了超过96%的AUROC,大大提高了AI图像识别任务的概括性.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 零拍摄图像分类 (ZIC) 旨在识别没有特定培训数据的新类别.
- 当前的方法在没有所有类别的培训数据时,与一般化作斗争.
- 基础模型为未见的类提供了强大的知识蒸能力.
研究的目的:
- 开发一个ZIC框架,利用基础模型进行增强的通用化.
- 为了能够识别培训数据集中缺少的新型图像类别.
- 在数据稀缺的情况下提高分类准确性.
主要方法:
- 利用ChatGPT和DALL-E从文本提示中合成未见类别的参考图像.
- 使用CLIP和DINO将测试图像与文本和合成参考图像对齐.
- 基于最终分类的信心计算的逻辑和聚合预测.
主要成果:
- 在多个数据集 (MNIST,SVHN,CIFAR-10/100,TinyImageNet) 中实现了对分类准确性的显著改进.
- 在所有测试的数据集上,接收器操作特征下达到的区域 (AUROC) 超过96%的得分.
- 与现有的零拍摄图像分类方法相比,证明了更高的性能.
结论:
- 拟议的框架有效地从基础模型中提炼知识,以进行强大的零拍摄图像分类.
- 这种方法增强了模型概括能力,用于识别以前未见的图像类别.
- 该方法为现实世界的应用提供了有前途的解决方案,在这些应用中,标记的数据是有限的.
相关概念视频
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
Aggregates Classification
306
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
306
Classification of Systems-I
177
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
177
Extraction: Advanced Methods
432
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
432
Classification of Systems-II
137
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
137
Modeling and Similitude
249
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
249


