对于高维和不完整数据的Nesterov加速第二阶隐性因子模型.
IEEE transactions on neural networks and learning systems
|October 13, 2023
概括
本研究为高维和不完整 (HDI) 数据引入了Nesterov加速的第二阶隐性因子 (LF) 模型. 与现有方法相比,新模型有效地提高了缺失数据估计的准确性.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 优化优化 优化优化
背景情况:
- 高维和不完整 (HDI) 数据在表示学习中带来了挑战.
- 隐性因子 (LF) 模型是有效的,但面临的局限性与非凸的客观函数.
- 一级方法缺乏准确性,而传统的二级方法在计算上昂贵.
研究的目的:
- 为HDI数据开发一个准确和高效的表示学习方法.
- 克服现有的LF模型在处理非凸的目标方面的局限性.
- 为了提高缺失数据估计的LF模型的性能.
主要方法:
- 提出了一个泛化的内斯特罗夫加速二阶LF (GNSLF) 模型.
- 集成了一个Hessian-vector算法,用于高效的第二阶段步骤获取.
- 采用了一般化的内斯特罗夫加速 (GNA) 方法来加快线性搜索过程.
- 专注于非凸成本函数的局部收分析.
主要成果:
- 与最先进的LF模型相比,GNSLF模型在缺失数据估计方面表现出更高的准确性.
- 实现了高效率,表明二级模型可以在不损失精度的情况下加速.
- 在6个HDI数据集上的实验结果验证了模型的性能.
结论:
- GNSLF模型提供了一个有效的解决方案,用于对HDI数据的表示学习.
- 将GNA与二级方法集成,可以显著提高效率.
- 这项研究为局部收性质提供了理论证明.
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
62
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
62
Friedman Two-way Analysis of Variance by Ranks
208
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
208
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
540
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
On...
540
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
79
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
79
Mechanistic Models: Compartment Models in Individual and Population Analysis
59
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
59
Noncompartmental Analysis: Statistical Moment Theory
113
Noncompartmental analyses leverage statistical moment theory to examine time-related changes in macroscopic events, encapsulating the collective outcomes stemming from the constituent elements in play. Statistical moment theory is a mathematical approach used to describe the time course of drug concentration in the body without assuming a specific compartmental model. SMT provides insights into drug absorption, distribution, metabolism, and elimination by treating drug concentration versus time...
113


