图形卷积网络的线性区域数的下限和上限
Hao Chen1, Yu Guang Wang2, Huan Xiong3
1Institute of Natural Sciences and School of Mathematical Sciences, Shanghai Jiao Tong University, Shanghai, China.
概括
本研究通过分析图形卷积网络 (GCN) 中的线性区域来估计图形神经网络 (GNN) 的表达力. 较深的GCN比较浅的GCN显示出每个参数的指数级更高的表达力.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 图形神经网络的神经网络
背景情况:
- 图形神经网络 (GNN) 越来越多地用于图形数据分析.
- 描述GNN表达力对于理解它们的能力至关重要.
- 神经网络中的线性区域作为表达力的衡量标准.
研究的目的:
- 在单层和多层图形卷积网络 (GCN) 中估计线性区域的数量.
- 用 ReLU 激活函数分析 GCN 的表达力.
- 为了比较浅层与深层GCN架构的表达力.
主要方法:
- 在单层GCN中导出线性区域的最佳上限.
- 确定多层GCN中线性区域的上下界限.
- 使用模拟结果来估计线性区域的真实数量.
主要成果:
- 确定了单层GCN中线性区域的最佳上限.
- 确定了多层GCN中线性区域的上下界限.
- 模拟表明,线性区域的真实数量更接近下界.
结论:
- 与单层 GCN 相比,多层 GCN 对每个参数的表达力呈指数级高.
- 更深层的GCN架构比它们的浅层对应更具表现力.
- 这些发现有助于理解GNN的代表力.
相关概念视频
Region of Convergence of Laplace Tarnsform
566
The Region of Convergence (ROC) is a fundamental concept in signal processing and system analysis, particularly associated with the Laplace transform. The ROC represents an area in the complex plane where the Laplace transform of a given signal converges, determining the transform's applicability and utility.
Consider a decaying exponential signal that begins at a specific time. When deriving its Laplace transform, the time-domain variable is replaced with a complex variable. This...
Consider a decaying exponential signal that begins at a specific time. When deriving its Laplace transform, the time-domain variable is replaced with a complex variable. This...
566
Region of Convergence
458
The z-transform is a powerful mathematical tool used in the analysis of discrete-time signals and systems. It is a crucial tool in the analysis of discrete-time systems, but its convergence is limited to specific values of the complex variable z. This range of values, known as the Region of Convergence (ROC), is fundamental in determining the behavior and stability of a system or signal. The ROC defines the region in the complex plane where the z-transform converges, which can take various...
458
Convolution Properties I
160
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
160
Convolution Properties II
215
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
215
Reducing Line Loss
159
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
159
Boundary Conditions: Lossless Lines
101
Consider a single-phase, two-wire, lossless transmission line terminated by an impedance at the receiving end and a source with Thevenin voltage and impedance at the sending end. The line, with length, has a surge impedance and wave velocity determined by the line's inductance and capacitance.
At the receiving end, the boundary condition states that the voltage equals the product of the receiving-end impedance and current. This relationship is expressed as a function of the incident and...
At the receiving end, the boundary condition states that the voltage equals the product of the receiving-end impedance and current. This relationship is expressed as a function of the incident and...
101


