复杂值的软日志值重权重复复杂值卷积神经网络的稀疏性
1School of Electronics and Information Engineering, Soochow University, Suzhou 215006, PR China.
概括
一个新的复杂值软日志值重权算法 (CV-SLTR) 有效地修剪复杂值卷积神经网络 (CVCNNs). 这种方法减少了CVCNN中的参数和计算,以提高信号分类的性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 复杂值卷积神经网络 (CVCNNs) 在分类复杂信号和合成孔径雷达 (SAR) 数据方面表现出色.
- 由于具有复杂值的参数,CVCNN经常遭受冗余和沉重的计算成本.
- 模型稀疏性是减轻冗余性而不会显著降低性能的一个关键技术.
研究的目的:
- 引入一种新的算法,即复杂值软日志值重权 (CV-SLTR),用于设计稀疏的CVCNN.
- 为了减少重量参数的数量,并简化CVCNNs的结构.
- 为了解决CVCNN中稀疏性的有限研究.
主要方法:
- 开发了一个复杂值的逻辑和值方法,考虑到复杂数的独特属性.
- 在复杂值卷积层 (CConv) 和复杂值完全连接层 (CFC) 中创建了不同的复杂值软和逻辑总值值技术,用于修剪重量.
- 使用稀疏预算在向后传播期间优化了稀疏度值,并证明了与随机梯度下降 (SGD) 的趋同.
主要成果:
- CV-SLTR算法有效地实现了CVCNN中的稀疏性.
- 在RadioML 2016.10A和S1SLC-CVDL数据集上的实验证实了算法的效率.
- 提出的方法证明了快速实现稀疏性,同时保持高分类准确性.
结论:
- CV-SLTR算法是一种可行且有前途的方法,用于创建稀疏的CVCNNs.
- 这种技术提供了一种减少计算复杂性的方法,并提高复杂的信号处理任务的效率.
- 这些发现突显了CV-SLTR在需要高效CVCNN的实际应用中的潜力.
相关概念视频
01:18Reducing Line Loss
150
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
150
01:11Residuals and Least-Squares Property
7.3K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.3K
01:16Vector Representation of Complex Numbers
117
Complex numbers, represented in Cartesian coordinates, can also be visualized as vectors. These vectors can be expressed in polar form, emphasizing their magnitude and angle. When a complex number is input into a function, the output is another complex number, highlighting the function's zero point from which the vector representation can originate.
Consider a function defined as the product of the complex factors in the numerator divided by the product of the complex factors in the...
Consider a function defined as the product of the complex factors in the numerator divided by the product of the complex factors in the...
117
01:20Convolution Properties I
142
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
142
01:26Linear Approximation in Frequency Domain
88
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
88
01:17Convolution Properties II
176
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
176