QC-ODKLA:通过线性ADMM进行量化和通信审查的在线去中心化内核学习
IEEE transactions on neural networks and learning systems
|September 13, 2023
概括
本研究引入了一种新的方法,用于使用随机特征进行分散的在线内核学习. 拟议的算法有效地学习预测函数,同时最大限度地降低通信成本并实现最佳后悔.
科学领域:
- 机器学习 机器学习
- 分散式系统 分散式系统 分散式系统
- 信号处理 信号处理
背景情况:
- 在线内核学习使代理商能够从数据流中协作学习.
- 分散网络面临着诸如高维度和通信开销等挑战.
- 重现内核希尔伯特空间 (RKHS) 对于非线性函数近似来说至关重要.
研究的目的:
- 为分散网络开发一个高效的在线内核学习框架.
- 用随机特征映射来解决维度的诅咒.
- 在分散式学习算法中提高通信效率.
主要方法:
- 利用随机特征 (RF) 映射将内核学习转化为参数问题.
- 通过线性ADMM (ODKLA) 框架提出了在线去中心化内核学习.
- 引入了量子化和审查以提高通信效率,创建了QC-ODKLA.
主要成果:
- 理论上证明了ODKLA和QC-ODKLA算法的最佳线下遗憾.
- 通过数值实验证明了有效的学习,沟通和计算效率.
- 验证了拟议的去中心化内核学习方法的性能.
结论:
- ODKLA和QC-ODKLA提供高效的解决方案,用于在线内核学习在分散的设置.
- 这些方法有效地管理了维度和通信限制.
- 拟议的算法提供了一种强大的方法,用于从流数据中进行协作学习.
相关概念视频
Linear Approximation in Frequency Domain
109
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
109
Linear Approximation in Time Domain
99
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
99
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
79
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
79
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model
87
Drugs administered through various routes can lead to nonlinear elimination, resulting in complex pharmacokinetic behaviors crucial to understanding efficacious drug dosing.
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
87
Linear time-invariant Systems
285
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
285
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
566
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
On...
566


