在不断变化的分配转移下,联合学习
Xuwei Tan1, Tian Xie1, Xue Zheng2
1Department of Computer Science and Engineering, The Ohio State University, Columbus, OH 43210, USA.
Entropy (Basel, Switzerland)
|January 28, 2026
概括
联合学习 (FL) 模型现在可以适应随时间变化的客户端数据分布. 新的算法,FedEvolve和FedEvp,确保模型对未来的数据进行概括,尽管模式在不断变化.
科学领域:
- 机器学习 机器学习
- 分布式系统 分布式系统
- 人工智能的人工智能
背景情况:
- 联合学习 (FL) 允许在不集中原始数据的情况下进行协作模式培训.
- 现有的FL方法通常假定静态的客户端数据分布,这是不现实的.
- 现实世界FL场景涉及客户数据随着时间的推移而发生的动态,非微不足道的变化,即使是在培训和测试之间.
研究的目的:
- 开发能够在随时间变化的客户数据上训练模型的FL算法.
- 加强FL系统的稳定性,以应对不断变化的数据分布转移.
- 在动态FL环境中实现对未来目标数据的概括.
主要方法:
- 拟议的FedEvolve算法:通过学习连续客户端数据域之间的表示过渡来明确模拟时间演变.
- 拟议的FedEvp算法:通过将当前数据与所有过去域的持续更新的原型对齐来学习演变域不变表示.
- 在合成和现实世界数据集上进行了广泛的实验.
主要成果:
- 与传统的FL基线相比,FedEvolve和FedEvp显示出显著的业绩改善.
- 提出的算法有效地捕获了客户端数据分布中的不断变化的模式.
- 这些方法在不断变化的分布转移下显示出稳健性和强大的泛化能力.
结论:
- 提出的FedEvolve和FedEvp算法成功地解决了联合学习中的动态客户端数据分布的挑战.
- 这些新的方法使FL系统能够有效地对未来的数据进行概括,尽管时间变化.
- 这些发现强调了在现实FL应用中考虑数据演变的重要性.
相关概念视频
Avoidance Learning and Learned Helplessness
2.6K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.6K
Drug Distribution: Volume of Distribution
7.4K
The volume of distribution refers to the theoretical volume necessary to contain the entire amount of an administered drug at the same concentration observed in the blood plasma. The body's intracellular fluid compartment, which makes up two-thirds of the total body water, is contrasted with the extracellular fluid compartment—comprising plasma and interstitial fluid—that accounts for one-third. The volume of distribution can vary depending on the characteristics of the drug.
7.4K
F Distribution
10.7K
The F distribution was named after Sir Ronald Fisher, an English statistician. The F statistic is a ratio (a fraction) with two sets of degrees of freedom; one for the numerator and one for the denominator. The F distribution is derived from the Student's t distribution. The values of the F distribution are squares of the corresponding values of the t distribution. One-Way ANOVA expands the t test for comparing more than two groups. The scope of that derivation is beyond the level of this...
10.7K
Associative Learning
1.3K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.3K
Purposive Learning
470
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
470
Observational Learning
893
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
893


