相关实验视频
顺序-最佳的拜占庭-强大的学习通过公平的梯度剪切在异质性下
IEEE transactions on cybernetics
|November 11, 2025
概括
这项研究介绍了一种新的渐变剪切方法,用于拜占庭-强大的联合学习 (FL). 新的聚合规则提高了机器学习 (ML) 模型的趋同性和准确性,即使使用异质数据,也优于现有方法.
科学领域:
- 机器学习 机器学习
- 分布式系统 分布式系统
- 网络安全 网络安全
背景情况:
- 联合学习 (FL) 容易受到破坏机器学习 (ML) 算法融合的拜占庭式攻击.
- 现有的强有力的聚合规则经常与异质数据作斗争,或缺乏理论保障.
- 当前的方法可能会增加计算负载或缺乏故障点分析.
研究的目的:
- 提出一个新的,理论上是正确的聚合规则,拜占庭-强壮的FL.
- 为了应对数据异质性下的强有力的规则的性能退化.
- 为了实现最佳的拜占庭-强大的训练错误,减少计算复杂性.
主要方法:
- 引入了一项新的聚合规则,该规则根据从聚合中心距离的距离将工人梯度剪切.
- 进行理论分析以确定拟议规则的崩点.
- 进行实验验证,将新规则与现有的基于中位数的方案进行比较.
主要成果:
- 拟议的规则实现了0.5的分解点,这是强大的聚合器的最大值.
- 该方法证明了顺序最佳的拜占庭强健训练错误,在数据异质性下表现优于坐标智能中位数 (CM) 和几何中位数 (GM).
- 实验结果证实了该机制对各种攻击的有效性,以及其对现有规则的优越性.
结论:
- 设计的梯度剪切聚合规则在联合学习中提供了优越的拜占庭稳定性和训练准确性,特别是在异质数据中.
- 这种方法为安全的分布式机器学习提供了理论上有保证的,计算效率高且实际上有效的解决方案.
- 这些发现通过提供更具弹性和高性能的聚合策略,推进了强大的联合学习领域.
相关概念视频
Routh-Hurwitz Criterion II
924
In the application of the Routh-Hurwitz criterion, two specific scenarios can arise that complicate stability analysis.
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
924
Application of Nonlinear Inequalities
196
A nonlinear inequality describes a comparison involving an expression that curves or behaves more complexly than a straight line. These inequalities often appear in forms that include squares, products, or variables in the denominator.To solve such an inequality, one starts by rewriting it so that zero appears on one side. For example, the inequality: can be factored as: This form makes it easier to identify the values that cause the expression to equal zero. In this case, the...
196
Routh-Hurwitz Criterion I
516
Consider an electrical power grid, where stability is essential to prevent blackouts. The Routh-Hurwitz criterion is a valuable tool for assessing system stability under varying load conditions or faults. By analyzing the closed-loop transfer function, the Routh-Hurwitz criterion helps determine whether the system remains stable.
To apply the Routh-Hurwitz criterion, a Routh table is constructed. The table's rows are labeled with powers of the complex frequency variable s, starting from the...
To apply the Routh-Hurwitz criterion, a Routh table is constructed. The table's rows are labeled with powers of the complex frequency variable s, starting from the...
516
Randomized Experiments
8.8K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
8.8K
Observational Learning
804
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
804
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
3.8K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
3.8K