EBM-WGF:训练基于能源的模型与瓦斯斯坦梯度流的流量
Ben Wan1, Cong Geng2, Tianyi Zheng1
1Shanghai Jiao Tong University, Minhang Distinct, Shanghai, China.
概括
本研究介绍了瓦斯斯坦梯度流 (Wasserstein gradient flow,简称WGF) 以稳定基于能量的模型 (EBM),用于密度估计. 这种新方法提高了生成器的优化,避免了计算上昂贵的MCMC采样,并提高了最小游戏的稳定性.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 计算统计学 计算统计学
背景情况:
- 基于能源的模型 (EBM) 对于密度估计是有效的,但在马尔科夫链蒙特卡洛 (MCMC) 采样中面临计算挑战.
- 使用minimax游戏的现有EBM提高了效率,但受到不稳定的能量估计和发电机优化的影响.
- 极限EBM的不稳定性源于通过标准梯度流来最小化不准确的KL分歧.
研究的目的:
- 提高基于能源的密度估计模型的稳定性和效率.
- 在传统的EBM中解决MCMC采样的计算费用.
- 为了克服基于游戏的EBMs中的不稳定性问题.
主要方法:
- 利用瓦斯斯坦梯度流 (Wasserstein gradient flow,简称WGF) 来纠正最小游戏中的发电机优化方向.
- 将WGF拉回参数空间并使用变量方案解决局限解决方案错误.
- 开发一种新的EBM,结合WGF,避免MCMC采样.
主要成果:
- 拟议的EBM与WGF展示了在发电机优化中增强的稳定性.
- 这种方法中的WGF解决方案相当于MCMC采样中使用的朗格文动态,提供计算优势.
- 对玩具和自然数据集的实证验证证了该方法的有效性.
结论:
- 与WGF结合的新型EBM为传统方法提供了稳定且计算效率高的替代方案.
- 这种方法有效地解决了基于minimax游戏的EBM固有的不稳定性问题.
- 该方法为推进机器学习中的密度估计技术提供了一个有希望的方向.
相关概念视频
Energy Conservation and Bernoulli's Equation
8.4K
Applying the conservation of energy principle or the work-energy theorem to an incompressible, inviscid fluid in laminar, steady, irrotational flow leads to Bernoulli's equation. It states that the sum of the fluid pressure, potential, and kinetic energy per unit volume is constant along a streamline.
All the terms in the equation have the dimension of energy per unit volume. The kinetic energy per unit volume is called the kinetic energy density, and the potential energy per unit volume is...
All the terms in the equation have the dimension of energy per unit volume. The kinetic energy per unit volume is called the kinetic energy density, and the potential energy per unit volume is...
8.4K
Bernoulli's Equation
9.9K
In the middle of the nineteenth century, it was observed that two trains passing each other at a high relative speed get pulled towards each other. The same occurs when two cars pass each other at a high relative speed. The reason is that the fluid pressure drops in the region where the fluid speeds up. As the air between the trains or the cars increases in speed, its pressure reduces. The pressure on the outer parts of the vehicles is still the atmospheric pressure, while the resultant...
9.9K
Energy Line and Hydraulic Gradient Line
578
Based on Bernoulli's equation, the energy line (EL) and hydraulic grade line (HGL) provide graphical representations of energy distribution in a fluid flow system. For steady, incompressible, inviscid flows, Bernoulli's equation is expressed as:
578
Bernoulli's Equation for Flow Along a Streamline
575
Bernoulli's equation relates the energy conservation in a fluid moving along a streamline. The equation applies to incompressible and inviscid fluids under steady flow. For such a flow, Newton's second law is applied to a small fluid element, which experiences forces due to pressure differences, gravity, and velocity variations. The force balance leads to the following form of Bernoulli's equation:
575
Typical Model Studies
211
Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
211
Energy Considerations in Open Channel Flow
57
Open channel flow, where a fluid flows with a free surface exposed to the atmosphere, is primarily governed by gravitational and surface effects, distinguishing it from closed conduit or pipe flow. In open channels such as rivers, canals, and artificial channels, energy analysis provides valuable insights into flow behavior and the relationship between depth, velocity, and slope.Specific Energy and Flow DepthIn open channel flow, the specific energy, E, combines the gravitational potential...
57


