关于混合模型中非参数最大概率估计器的高效和可扩展计算
Yangjing Zhang1, Ying Cui2, Bodhisattva Sen3
1Institute of Applied Mathematics, Academy of Mathematics and Systems Science, Chinese Academy of Sciences.
本研究引入了一种高效的增强拉格朗方法 (ALM),用于在混合模型中计算非参数最大概率估计器 (NPMLE). 这种新的方法可以处理大型数据集,并提高复杂数据分析的可扩展性.
科学领域:
- 统计 统计 统计 统计
- 计算统计学 计算统计学
- 机器学习 机器学习
背景情况:
- 混合模型被广泛用于数据分析,但计算非参数最大概率估计器 (NPMLE) 在计算上具有挑战性.
- 现有的方法难以处理大型数据集和高维问题.
研究的目的:
- 在多变量混合模型中开发一个高效和可扩展的算法来计算NPMLE.
- 解决大规模混合物模型估计的计算挑战.
- 在经验贝叶斯框架内应用计算的NPMLE来否定观测.
主要方法:
- 通过固定支点来对无限维度优化问题的分离.
- 使用半牛顿增强拉格朗方法 (ALM) 优化混合比例.
- 利用解决方案稀疏性来实现高效的黑斯计算和改进的扩展.
主要成果:
- 拟议的ALM超越了最先进的方法,处理数百万个数据点和数千个支持点.
- 该算法在支持点数方面表现出优越的扩展,与mixsqp.mixsqp.等现有方法相比.
- 提出并验证了新的denoising估计值及其一致估计值.
结论:
- 在大型混合模型中,ALM为NPMLE计算提供了高效和可扩展的解决方案.
- 该方法对于实证贝叶斯无效应用是有效的,如天文学数据集所示.
- 该方法为复杂的统计建模任务提供了显著的计算优势.
更多相关视频
13:54A Workflow for Lipid Nanoparticle LNP Formulation Optimization using Designed Mixture-Process Experiments and Self-Validated Ensemble Models SVEM
Published on: August 18, 2023
12:27Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations
Published on: February 15, 2017
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
On...
Distributions to Estimate Population Parameter
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
Mechanistic Models: Compartment Models in Individual and Population Analysis
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
