神经常规微分方程流的高阶扩展
Dario Izzo1, Sebastien Origer1, Giacomo Acciarini1
1Advanced Concepts Team, European Space Research and Technology Centre (ESTEC), Keplerlaan 1, 2201 AZ Noordwijk, Netherlands.
Science advances
|December 17, 2025
概括
事件过渡张量提供了一种新的方法来解释神经常规微分方程 (NeuralODEs) 中的复杂动态. 该工具增强了动态系统中的机器学习模型的可解释性和分析验证.
科学领域:
- 动态系统和控制理论.
- 机器学习和人工智能的人工智能
- 计算数学 计算数学 计算数学
背景情况:
- 人工神经网络 (ANN) 越来越多地用于模拟普通微分方程 (ODEs),从而创建神经ODE.
- 在ODE研究中,ANNs的"黑盒子"性质限制了学习动态的可解释性和可信性.
- 目前神经ODEs的分析方法受到计算约束的限制,将洞察力限制在第一阶梯度上.
研究的目的:
- 引入一个新的工具,事件过渡张量,用于严格的数学描述和分析NeuralODE动态.
- 增强神经ODEs模拟的复杂动态的可解释性和分析验证.
- 为封装和分析神经动态提供一个计算高效的方法.
主要方法:
- 开发和应用事件过渡张量,结合高阶微分信息.
- 使用这些张量对事件多元体上的NeuralODE动态进行数学描述.
- 跨多种应用程序的演示,包括控制模型,最佳反和哈密尔顿系统.
主要成果:
- 事件过渡张量为理解NeuralODE动态提供了一个严格的数学框架.
- 该方法通过揭示明确的数学结构来实现可解释性和分析验证.
- 神经动力学完全封装在紧的,计算效率高的张量器中,用于严格的分析和认证.
结论:
- 事件过渡张量显著提升了事件触发的神经微分方程的理论基础.
- 这种方法为解释由神经ODEs建模的复杂系统动态提供了一个关键的数学构造.
- 这些发现促进了对数据驱动动态系统在科学应用中的更大的信任和部署.
相关概念视频
Linear Approximation in Frequency Domain
329
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
329
Second Derivatives and Laplace Operator
2.6K
The first order operators using the del operator include the gradient, divergence and curl. Certain combinations of first order operators on a scalar or vector function yield second order expressions. Second-order expressions play a very important role in mathematics and physics. Some second order expressions include the divergence and curl of a gradient function, the divergence and curl of a curl function, and the gradient of a divergence function.
Consider a scalar function. The curl of its...
Consider a scalar function. The curl of its...
2.6K
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Second Order systems II
369
In an underdamped second-order system, where the damping ratio ζ is between 0 and 1, a unit-step input results in a transfer function that, when transformed using the inverse Laplace method, reveals the output response. The output exhibits a damped sinusoidal oscillation, and the difference between the input and output is termed the error signal. This error signal also demonstrates damped oscillatory behavior. Eventually, as the system reaches a steady state, the error diminishes to zero.
369
Transmission-Line Differential Equations
935
Transmission lines are essential components of electrical power systems. They are characterized by the distributed nature of resistance (R), inductance (L), and capacitance (C) per unit length. To analyze these lines, differential equations are employed to model the variations in voltage and current along the line.
Line Section Model
A circuit representing a line section of length Δx helps in understanding the transmission line parameters. The voltage V(x) and current i(x) are measured from...
Line Section Model
A circuit representing a line section of length Δx helps in understanding the transmission line parameters. The voltage V(x) and current i(x) are measured from...
935
Convolution: Math, Graphics, and Discrete Signals
796
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
796


