Enhancing the efficiency of variational autoregressive networks through renormalization group
Sihan Wang1, Zhirong Liu1,2
1Peking University, College of Chemistry and Molecular Engineering, Beijing 100871, China.
None:
Estimating free energy is a fundamental and difficult problem in statistical physics. In recent years, machine-learning methods, especially deep generative models, have been extensively applied to this problem. The variational autoregressive network (VAN) is one of the most successful methods. VAN has notable advantages, such as tractable probabilities from normalized distribution or the absolute value of the free energy. However, the sampling process of VAN is serial, which limits its application to high-dimensional and large-scale systems. In this work, we utilize renormalization group (RG) with VAN, namely RG-VAN, to improve the sampling efficiency of VAN. The method reduces the computational complexity from polynomial to logarithmic with respect to the degrees of freedom. Numerical experiments on the two-dimensional Ising model and Edwards-Anderson model show that RG-VAN can accelerate the training and inference process by an order of magnitude, with little loss of accuracy.
Related Concept Videos
Regression Toward the Mean
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
On...
Application of Linearization and Approximation
Random Variables
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Linearization and Approximation
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
