相关实验视频
Updated: Jun 28, 2025
04:48
Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
Published on: July 5, 2024
394
通过分离指数最大化,通过卷积神经网络的前进层级学习来最大化分离指数
Ali Karimi1, Ahmad Kalhor2, Melika Sadeghi Tabrizi1
1School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran.
Scientific reports
|April 13, 2024
概括
这项研究介绍了对卷积神经网络 (CNN) 的新型前进层智能学习算法. 它通过使用分离指数 (SI) 优化层复杂性来提高分类准确性和效率.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 传统的深度学习算法通常依赖于反向传播,这可能是计算密集的,并且可能与消失梯度作斗争.
- 层级培训为优化复杂的神经网络架构提供了潜在的替代方案,但有效的方法仍在开发中.
研究的目的:
- 在分类任务中为卷积神经网络 (CNN) 提出一种新的前进层智能的学习算法.
- 引入分离指数 (SI) 作为监督的复杂度指标,用于评估和培训个别网络层.
- 通过前进的层次方法,通过减少数据不确定性和干扰来证明改进的特征表示.
主要方法:
- 提出了一个前置层智能的学习算法,利用分离指数 (SI) 来测定和训练每个层次的顺序.
- 使用局部三重损失的变体近似计算SI,使得基于梯度的最大化能够增强特征表示.
- 该算法以向前传递的方式运行,灵感来自于活动差异的神经梯度表示 (NGRAD) 假设,而不需要从最后层发出的明确错误信号.
主要成果:
- 与最先进的方法相比,拟议的算法在各种图像分类数据集 (CIFAR-10,CIFAR-100,Raabin-WBC,Fashion-MNIST) 和架构 (VGG16,VGG19,AlexNet,LeNet) 中在准确性方面取得了卓越的性能.
- 对文本分类任务 (DBPedia,AG的新闻) 的评估也显示出显著的改进.
- 该方法表明时间复杂度提高,表明效率更高.
结论:
- 前进层智能学习算法通过改进特征空间表示来有效优化CNN的分类.
- 分离指数 (SI) 作为层级培训的可行复杂度指标,优于现有方法.
- 这种方法为训练深度神经网络提供了一个计算效率高,准确的替代方案.
相关概念视频
01:18Reducing Line Loss
151
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
151
01:11Residuals and Least-Squares Property
7.4K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.4K
01:27Associative Learning
350
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
350
01:26Linear Approximation in Frequency Domain
89
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
89
01:24Convolution: Math, Graphics, and Discrete Signals
249
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
249
01:17Convolution Properties II
197
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
197