科尔摩戈罗夫n宽度多任务物理信息机器学习 (PIML) 方法:朝着强大的指标
Michael Penwarden1, Houman Owhadi2, Robert M Kirby1
1Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, UT 84112, USA; Kahlert School of Computing, University of Utah, Salt Lake City, UT 84112, USA.
概括
基于物理的机器学习 (PIML) 提供了一种解决部分微分方程 (PDE) 的新方法. 本研究引入了Kolmogorov n-widths作为对比PIML模型的客观指标,提高了它们的概括性和验证性.
科学领域:
- 计算科学与工程 计算科学与工程
- 机器学习 机器学习
- 应用数学 应用数学 应用数学
背景情况:
- 基于物理的机器学习 (PIML) 将物理定律集成到机器学习中,用于解决部分微分方程 (PDEs).
- 在PIML中的多任务学习同时解决单个或多个PDE问题.
- 将不同的PIML方法进行比较和基准测试仍然是一个重大挑战.
研究的目的:
- 引入一个客观的指标来比较各种多任务物理知情机器学习架构.
- 分析PIML模型在使用Kolmogorov n-widths近似函数中的有效性.
- 提高PIML模型用于解决PDE的可通用性和验证性.
主要方法:
- 应用科尔摩戈罗夫n宽度来量化多任务PIML模型的近似效率.
- 对PIML架构的较低准确度极限的计算.
- 在PIML模型中对不同PDE问题的学习基础函数的分析.
- 通过规范化将科尔莫戈罗夫n宽度度量纳入模型优化过程.
主要成果:
- 该研究为比较多任务PIML架构提供了第一个客观指标,减少了选择性采样和过度装配的不确定性.
- 识别到的激活函数显著影响到最坏情况下的模型概括.
- 使用科尔莫戈罗夫n宽度度的规范化提高了跨多任务PDE问题的模型通用性.
结论:
- 科尔摩戈罗夫n宽度为评估和比较多任务PIML模型提供了强大的客观指标.
- 拟议的指标有助于识别架构改进,特别是在激活功能方面.
- 将此指标集成到优化中可以提高PIML模型的性能和可靠性,从而解决复杂的PDE问题.
相关概念视频
01:20Maxwell-Boltzmann Distribution: Problem Solving
1.4K
Individual molecules in a gas move in random directions, but a gas containing numerous molecules has a predictable distribution of molecular speeds, which is known as the Maxwell-Boltzmann distribution, f(v).
This distribution function f(v) is defined by saying that the expected number N (v1,v2) of particles with speeds between v1 and v2 is given by
This distribution function f(v) is defined by saying that the expected number N (v1,v2) of particles with speeds between v1 and v2 is given by
1.4K
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
45
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
45
01:06Collisions in Multiple Dimensions: Problem Solving
3.7K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
3.7K
01:30Three-Dimensional Force System:Problem Solving
653
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
653
01:05Collisions in Multiple Dimensions: Introduction
4.9K
It is far more common for collisions to occur in two dimensions; that is, the initial velocity vectors are neither parallel nor antiparallel to each other. Let's see what complications arise from this. The first idea is that momentum is a vector. Like all vectors, it can be expressed as a sum of perpendicular components (usually, though not always, an x-component and a y-component, and a z-component if necessary). Thus, when the statement of conservation of momentum is written for a...
4.9K
01:05Estimation of the Physical Quantities
4.2K
On many occasions, physicists, other scientists, and engineers need to make estimates of a particular quantity. These are sometimes referred to as guesstimates, order-of-magnitude approximations, back-of-the-envelope calculations, or Fermi calculations. The physicist Enrico Fermi was famous for his ability to estimate various kinds of data with surprising precision. Estimating does not mean guessing a number or a formula at random. Instead, estimation means using prior experience and sound...
4.2K