激活功能可循环切换的卷积神经网络模型
1Departmant of Computer Engineering, Erzincan Binali Yıldırım University, Erzincan, Turkey.
PeerJ. Computer science
|March 28, 2025
概括
本研究介绍了可循环切换的卷积神经网络 (AFCS-CNN) 的激活功能,这是一种在训练期间动态切换激活功能的新方法. 这种方法可以提高神经网络的性能,而不需要固定或可训练的激活功能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 激活函数是关键的超参数,显著影响神经网络的训练和性能.
- 在深度学习中,为特定任务选择最佳激活函数仍然是一个具有挑战性的问题.
- 现有的解决方案包括固定激活功能或可训练激活功能,每个都有局限性.
研究的目的:
- 提出一种新的神经网络架构,在训练期间动态调整其激活功能.
- 为了引入激活函数循环切换卷积神经网络 (AFCS-CNN) 模型.
- 为了证明固定或可训练的激活函数方法的替代方案,以提高模型性能.
主要方法:
- 开发了AFCS-CNN模型,该模型在训练过程中循环切换多个激活功能.
- 该模型通过根据性能选择最优的激活功能来自我调节,适应性能下降.
- 在Cifar-10数据集上进行了废除研究,以确定AFCS-CNN结构的最佳CNN模型和超参数.
主要成果:
- AFCS-CNN模型在各种卷积神经网络 (CNN) 模型中展示了最先进的性能.
- 对各种数据集的实验证实了拟议的AFCS-CNN结构的有效性和适应性.
- 该模型取得了显著的成功,在多种场景中表现优于传统方法.
结论:
- AFCS-CNN模型提供了一种简单而高效的方法,用于优化神经网络中的激活函数选择.
- 这种动态切换方法为静态或可训练的激活功能提供了强大的替代方案.
- 拟议的架构实现了最先进的结果,突出了其在推进深度学习应用程序方面的潜力.
相关概念视频
Neural Circuits
3.0K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
3.0K
Network Function of a Circuit
1.1K
Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.
1.1K
Convolution: Math, Graphics, and Discrete Signals
1.3K
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
1.3K
Convolution Properties I
773
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
773
Convolution Properties II
752
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
752
State Space to Transfer Function
691
The conversion of state-space representation to a transfer function is a fundamental process in system analysis. It provides a method for transitioning from a time-domain description to a frequency-domain representation, which is crucial for simplifying the analysis and design of control systems.
The transformation process begins with the state-space representation, characterized by the state equation and the output equation. These equations are typically represented as:
The transformation process begins with the state-space representation, characterized by the state equation and the output equation. These equations are typically represented as:
691


