在深度视觉词包模型中使用预训练的深度学习模型作为特征提取器是否总是可以提高图像分类准确性?
Ye Xu1, Xin Zhang1, Chongpeng Huang1
1School of IoT Technology, Wuxi Institute of Technology, Wuxi, Jiangsu, China.
PloS one
|February 29, 2024
概括
在 Bag-of-Deep-Visual-Words 模型中,使用预训练的深度学习模型作为特征提取器可以提高分类准确性,特别是在 Fisher Vector 编码中. 这种方法显示了在各种数据集和模型中提高性能的巨大潜力.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 深度学习模型通常通过重新训练其最终层来直接用于分类.
- 其他方法涉及使用预训练模型作为其他分类框架内的特征提取器.
研究的目的:
- 调查是否使用预训练的深度学习模型作为特征提取器在Bag-of-Deep-Visual-Words (BoDVW) 中,与直接分类相比,持续提高分类准确性.
- 分析各种因素的影响,包括特征提取方法,特征编码技术和模型微调策略.
主要方法:
- 采用了五种特征编码方法:硬投票,软投票,局部受约束的线性编码,超向量编码和费舍尔向量 (FV).
- 使用了两个特征提取方法:Ext-DFs ((CP) (卷积/非全球聚合层) 和Ext-DFs ((FC) (完全连接/全球聚合层).
- 在六个不同的数据集上进行了三种预训练模型 (VGGNet-16,ResNext-50,Swin-B) 的实验.
主要成果:
- 使用预训练模型作为与费舍尔向量编码的特征提取器,与仅重新训练分类层相比,在36个实验中,在35个实验中提高了准确性.
- 精度的增长范围从0.13%到8.43% (平均3.11%) 与Ext-DFs ((CP) 和1.06%到14.63% (平均5.66%) 与Ext-DFs ((FC).
- 微调所有层并使用FV与Ext-DFs (FC) 提高了18项实验中的14项的准确性,从0.21%到5.65% (平均1.58%) 的收益.
结论:
- 在BoDVW框架内使用预训练的深度学习模型作为特征提取器是提高分类准确性的有希望的技术.
- 效率取决于诸如特征编码 (FV是非常有效的) 和提取方法等因素,但它不能普遍保证提高准确性.
- 这种方法为各种计算机视觉任务的精度改进提供了显著的潜力.
相关概念视频
Improving Translational Accuracy
10.4K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
10.4K
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
Aggregates Classification
321
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
321
Classification of Signals
460
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
460
Classification of Systems-I
186
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
186
Classification of Systems-II
146
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
146


