科尔摩戈罗夫GAM网络就是你所需要的!
1Oxford University, Oxford OX1 2JD, UK.
Entropy (Basel, Switzerland)
|June 26, 2025
概括
科尔摩戈罗夫GAM (K-GAM) 网络为变压器提供了一个高效的机器学习替代方案. 这些模型利用科尔莫戈罗夫的叠加定理来实现紧的函数表示,减少参数并提高计算效率.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 科尔摩戈罗夫GAM (K-GAM) 网络是培训和推理的高效架构.
- 它们在机器学习中提供了变压器架构的替代方案.
- K-GAMs基于科尔莫戈罗夫的叠加定理 (KST),提供高效的多变量函数表示.
研究的目的:
- 在人工智能应用的机器学习环境中解释基于 KST 的表示.
- 为了呈现一个新的K-GAM架构作为变形金刚的替代品.
- 展示一个具有计算吸引力和参数效率的学习程序.
主要方法:
- 开发了一个K-GAM架构,相当于拓嵌入和通用添加模型 (GAM) 层.
- 使用KST来有效地表示多变量函数.
- 将方法应用于虹膜数据集以示例.
主要成果:
- K-GAM架构提供了一类学习程序,其参数比深度学习算法要少得多.
- 具有非线性嵌入的添加模型可以作为变压器架构 (内核光滑器) 的统计替代方案.
- 拟议的算法是可并行和具有计算吸引力的.
结论:
- 添加式KAN模型为变压器架构提供了一个自然而有效的替代方案.
- K-GAM方法为人工智能和机器学习的未来研究提供了一个有希望的方向.
- 这种方法允许有效编码字典和函数近似.
相关概念视频
Network Function of a Circuit
407
Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.
407
Sequence Networks of Rotating Machines
150
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
150
Network Covalent Solids
14.6K
Network covalent solids contain a three-dimensional network of covalently bonded atoms as found in the crystal structures of nonmetals like diamond, graphite, silicon, and some covalent compounds, such as silicon dioxide (sand) and silicon carbide (carborundum, the abrasive on sandpaper). Many minerals have networks of covalent bonds.
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
14.6K
Protein Networks
4.1K
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
4.1K
Vector Algebra: Graphical Method
14.1K
Vectors can be multiplied by scalars, added to other vectors, or subtracted from other vectors. The vector sum of two (or more) vectors is called the resultant vector or, for short, the resultant.
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
14.1K
Kirchoff's Rules: Application
1.7K
Kirchhoff's rules quantify the current flowing through a circuit and the voltage variations around the loop in a circuit. Applying Kirchhoff's rules generates a set of linear equations that allow us to find the unknown values in circuits. These may be currents, voltages, or resistances.
When applying Kirchhoff's first rule, the junction rule, label the current in each branch and decide its direction. If the chosen direction is wrong, it will have the correct magnitude, although the...
When applying Kirchhoff's first rule, the junction rule, label the current in each branch and decide its direction. If the chosen direction is wrong, it will have the correct magnitude, although the...
1.7K


