对于潜在数据增强的最佳层选择
Tomoumi Takase1, Ryo Karakida1
1Artificial Intelligence Research Center, National Institute of Advanced Industrial and Science Technology, Tokyo, Japan.
概括
将数据增强 (DA) 应用于隐藏层,或功能增强,可以提高神经网络的性能. 这项研究引入了一种自适应方法 (AdaLASE) 来自动选择DA的最佳层,提高测试准确性.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 数据增强 (DA) 通常会修改输入数据.
- 将DA应用于隐藏层 (功能增强) 显示了性能增长的潜力.
- 以前选择DA层的方法缺乏系统的调查,并且往往是任意的.
研究的目的:
- 为了研究在各种不同的实验环境中,为特征增强进行最佳层选择.
- 开发一种自动化方法,用于DA中的自适应层选择.
- 通过战略功能增强来增强神经网络的性能.
主要方法:
- 在各种培训模式 (从零开始,转移学习),数据集和模型中对功能增强的系统研究.
- 适应层选择 (AdaLASE) 方法的建议.
- 在训练过程中,AdaLASE利用梯度下降来动态调整每层DA应用的比例.
主要成果:
- 根据实验配置,确定了适合特征增强的层的趋势.
- 提出的AdaLASE方法成功地适应了每层的DA应用比率.
- 在多个图像分类数据集上实现了高整体测试准确性.
结论:
- 功能增强是改善神经网络性能的一种可行的策略.
- AdaLASE方法提供了一种自动化和有效的方法来优化功能增强层选择.
- 这项工作为在神经网络架构中应用DA提供了一种更有原则和数据驱动的方式.
相关概念视频
Survival Tree
61
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
61
Upsampling
206
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
206
Long-term Potentiation
2.7K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
2.7K


