一般化低级更新:低级培训数据修改的模型参数界限
Hiroyuki Hanada1, Noriaki Hashimoto2, Kouichi Taji3
1Center for Advanced Intelligence Project, RIKEN, Tokyo 103-0027, Japan hiroyuki.hanada@riken.jp.
Neural computation
|October 16, 2023
概括
本研究介绍了一种用于增量机器学习 (ML) 的通用低级更新 (GLRU) 方法. 当数据发生变化时,GLRU可以有效地更新模型,从而受益于交叉验证和特征选择.
科学领域:
- 机器学习 机器学习
- 计算统计学 计算统计学
背景情况:
- 增量机器学习 (ML) 对动态数据集至关重要.
- 现有的低级更新方法仅限于线性估计.
- 在数据变化后有效地更新ML模型在计算上具有挑战性.
研究的目的:
- 为ML开发一个通用的低级更新 (GLRU) 方法.
- 将高效的模型更新扩展到线性估计之外.
- 为了实现高效的交叉验证和特征选择.
主要方法:
- 开发了通用低级更新 (GLRU) 方法.
- 制定了ML方法作为规范化的经验风险最小化.
- 扩展低级更新框架以支持矢量机和后勤回归.
主要成果:
- 在GLRU方法有效地更新ML模型与增量数据变化.
- 实现的计算复杂度与数据变化的数量成比例.
- 在交叉验证和特征选择任务中证明了效率.
结论:
- GLRU显著提高了增量ML的效率.
- 该方法适用于更广泛的ML算法.
- 在动态环境中,GLRU为模型选择提供了一个实用的解决方案.
相关概念视频
Improving Translational Accuracy
11.4K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.4K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
57
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
57
Survival Tree
88
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
88
Friedman Two-way Analysis of Variance by Ranks
208
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
208
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
531
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
On...
531


