用各种物理机制解读和整合神经操作员学习的不变量
Rui Zhang1, Qi Meng2, Zhi-Ming Ma1
1Academy of Mathematics and Systems Science, Chinese Academy of Sciences (CAS), Beijing 100190, China.
National science review
|March 15, 2024
概括
本研究介绍了物理不变注意力神经运算符 (PIANO),这是一种新型的神经运算符,可以整合物理不变量,以在各种物理机制中改进部分微分方程 (PDE) 模拟. 在PDE预测任务中,PIANO显著提高了准确性.
科学领域:
- 计算科学与工程 计算科学与工程
- 科学的人工智能科学的人工智能
- 基于物理的机器学习
背景情况:
- 传统的部分微分方程 (PDE) 解析器在模拟复杂的物理系统时面临着局限性.
- 现有的神经操作员方法通常仅限于单一的物理机制,限制了它们在现实世界中的适用性.
- 需要先进的代孕模型,能够处理各种物理场景.
研究的目的:
- 开发一种新的神经运算器,即物理不变注意力神经运算器 (PIANO),用于模拟具有不同机制的物理系统.
- 将物理不变纳入操作员学习中,以提高代用模型的性能和适用性.
- 为了提高PDE预测在不同的物理条件的准确性和稳定性.
主要方法:
- PIANO利用自主监督学习从数据中提取关键的物理知识.
- 用注意力机制将提取的物理不变体集成到动态卷积层中.
- 该模型是在PDE系列上训练的,包括各种物理机制,系数,力和边界条件.
主要成果:
- 在PDE预测任务中,PIANO显示了相对错误的显著减少,从13.6%到82.2%,在PDE预测任务中.
- 该模型有效地处理系数,力和边界条件的变化.
- 由PIANO生成的物理不变量 (PI) 嵌入显示与PDE系统中潜在的物理不变量有很强的对齐.
结论:
- PIANO提供了一种强大的操作者学习方法,能够破译和整合物理不变量.
- 该方法显著提高了替代模型的准确性,用于模拟由PDEs控制的各种物理系统.
- 皮亚诺学习嵌入的物理意义验证了其在捕捉潜在的物理定律方面的有效性.
相关概念视频
Integrator and Differentiator
834
Op-amp circuits have significant applications in various fields, including automotive engineering. One such application is cruise control systems in cars, where op-amp circuits are integral for maintaining a constant speed. In these systems, op-amps function as both integrators and differentiators.
An integrator within an op-amp circuit produces an output directly proportional to the integral of the input signal. This is achieved by replacing the feedback resistor in a typical inverting...
An integrator within an op-amp circuit produces an output directly proportional to the integral of the input signal. This is achieved by replacing the feedback resistor in a typical inverting...
834
Propagation of Action Potentials
5.7K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
5.7K
Neural Circuits
1.2K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.2K
Convolution Properties II
199
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
199
Integration of Synaptic Events
1.5K
Synaptic integration mainly includes the summation of graded potentials. Graded potentials, regardless of their type, cause subtle alterations in membrane voltage, resulting in either depolarization or hyperpolarization. These incremental changes, when combined or summed, can propel the neuron toward its threshold. Consider, for example, a membrane experiencing a +15 mV shift, causing it to depolarize from -70 mV to -55 mV. In this scenario, graded potentials govern the membrane's ability to...
1.5K
Second Derivatives and Laplace Operator
1.2K
The first order operators using the del operator include the gradient, divergence and curl. Certain combinations of first order operators on a scalar or vector function yield second order expressions. Second-order expressions play a very important role in mathematics and physics. Some second order expressions include the divergence and curl of a gradient function, the divergence and curl of a curl function, and the gradient of a divergence function.
Consider a scalar function. The curl of its...
Consider a scalar function. The curl of its...
1.2K


