NN2Poly:深度输送人工神经网络的多项式表示.
IEEE transactions on neural networks and learning systems
|November 14, 2023
概括
NN2Poly提供了一个明确的多项式模型来解释训练有素的人工神经网络 (NN),将以前的方法扩展到用于回归和分类任务的深度学习模型.
科学领域:
- 人工智能的人工智能
- 机器学习理论机器学习理论
背景情况:
- 尽管深度学习取得了成功,神经网络 (NN) 的解释性仍然是一个挑战.
- 现有的NN解释性方法的范围通常是有限的.
研究的目的:
- 提出NN2Poly,这是一个理论方法,用于创建训练有素的前神经网络的显式多项式模型.
- 为了扩展NN的解释性,任意深的多层感知子 (MLPs),用于分类和回归.
主要方法:
- 在每个层使用泰勒扩展激活函数.
- 应用组合学属性来导出多项式系数.
- 通过引入培训约束来解决计算挑战.
主要成果:
- NN2Poly准确地将训练有素的MLP表示为显式多项式模型.
- 该方法对于深度网络和各种任务是有效的.
- 通过模拟和现实世界的表格数据集来证明.
结论:
- NN2Poly为理解复杂的神经网络提供了一个新的理论框架.
- 这种方法提高了深度学习模型的可解释性.
- 通过战略性培训修改,实际实施是可行的.
相关概念视频
Neural Circuits
1.3K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.3K
Linear Approximation in Frequency Domain
94
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
94
State Space Representation
213
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
213
Vector Representation of Complex Numbers
129
Complex numbers, represented in Cartesian coordinates, can also be visualized as vectors. These vectors can be expressed in polar form, emphasizing their magnitude and angle. When a complex number is input into a function, the output is another complex number, highlighting the function's zero point from which the vector representation can originate.
Consider a function defined as the product of the complex factors in the numerator divided by the product of the complex factors in the...
Consider a function defined as the product of the complex factors in the numerator divided by the product of the complex factors in the...
129
Linear time-invariant Systems
263
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
263
Parseval's Theorem for Fourier transform
1.0K
Parseval's theorem is a fundamental principle in signal processing that enables the calculation of a signal's energy in either the time domain or the frequency domain. This theorem is pivotal in demonstrating energy conservation between these two domains, ensuring that the computed energy value remains consistent regardless of the domain of analysis.
To understand Parseval's theorem, it is essential to first comprehend how signal energy is typically calculated. When considering a...
To understand Parseval's theorem, it is essential to first comprehend how signal energy is typically calculated. When considering a...
1.0K


