学习速度不是一个常数:三明治调整的马尔科夫链蒙特卡洛模拟
Jasper A Vrugt1, Cees G H Diks2
1Department of Civil and Environmental Engineering, University of California, Irvine, CA 92697, USA.
Entropy (Basel, Switzerland)
|October 28, 2025
概括
本研究引入了一种新的三明治调整的马尔科夫链蒙特卡洛 (MCMC) 方法和信息理论诊断,以解决贝叶斯推理中的模型错误规范. 新方法提供了可靠的不确定性估计,改进了常规方法,这些方法往往低估了变化.
科学领域:
- 统计 统计 统计 统计
- 计算统计学 计算统计学
- 贝叶斯的推理是贝叶斯的推理.
背景情况:
- 模型错误规范是最大概率和贝叶斯方法的一个关键限制.
- 标准方法在错误规范下产生偏差的协差矩阵,导致低估的不确定性.
- 现有的强大的后部采样方法有局限性.
研究的目的:
- 开发一种新的三明治调整的马尔科夫链蒙特卡洛 (MCMC) 方法,用于强大的贝叶斯推理.
- 引入信息理论诊断以量化模型错误规范.
- 在模型错误规范下提供异常有效和强大的不确定性估计.
主要方法:
- 开发了一种新的三明治调整的MCMC方法,用于方向特定的概率调节,具有参数依赖的学习速率.
- 建议的信息理论诊断,包括分歧得分和标量概要 (弗罗贝尼乌斯规范,地球移动器距离,赫芬达尔指数).
- 应用方法对参数分布和降雨-流水案例研究.
主要成果:
- 拟议的MCMC方法捕捉了方向不对称性,并产生了有效的可信区域.
- 传统的贝叶斯方法系统地低估了不确定性.
- 这种新方法提供了异常有效和强大的不确定性估计,优于标准方法.
结论:
- 对于强大的贝叶斯实践和工作流程,建议进行基于三明治的调整.
- 开发的诊断有效地通过评估灵敏度和可变性矩阵来评估模型错误规范.
- 新的MCMC方法提供了一种原则性的方法来处理模型错误规范,并改进不确定性量化.
相关概念视频
Randomized Experiments
8.8K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
8.8K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
282
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
282
Multi-input and Multi-variable systems
384
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
384
Observational Learning
817
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
817
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
1.1K
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
On...
1.1K
Temperature Dependence on Reaction Rate
88.5K
The Collision Theory
Atoms, molecules, or ions must collide before they can react with each other. Atoms must be close together to form chemical bonds. This premise is the basis for a theory that explains many observations regarding chemical kinetics, including factors affecting reaction rates.
The collision theory is based on the postulates that (i) the reaction rate is proportional to the rate of reactant collisions, (ii) the reacting species collide in an orientation allowing contact between...
Atoms, molecules, or ions must collide before they can react with each other. Atoms must be close together to form chemical bonds. This premise is the basis for a theory that explains many observations regarding chemical kinetics, including factors affecting reaction rates.
The collision theory is based on the postulates that (i) the reaction rate is proportional to the rate of reactant collisions, (ii) the reacting species collide in an orientation allowing contact between...
88.5K


