一个基于同步-异步机制的高效聚合算法,用于联合学习
Yangcheng Mou1, Aiwang Chen2, Guirong Chen1
1School of Information and Navigation, Air Force Engineering University, Xi'an, 710077, China.
Scientific reports
|November 19, 2025
概括
本研究介绍了SaAS-FL,一个联合学习 (FL) 算法,平衡通信效率和模型准确性. 它使用同步训练和异步更新,具有动态加权,以防止分布式系统的性能下降.
科学领域:
- 分布式系统 分布式系统
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 联合学习 (FL) 在分布式环境中越来越多地使用.
- 在保持模型性能的同时提高通信效率是FL的一个关键挑战.
研究的目的:
- 提出SaAS-FL,一个创新的FL算法,旨在平衡模型准确性和通信效率.
- 为应对FL系统中陈旧客户端和潜在的模型退化所带来的挑战.
主要方法:
- 采用同步训练模式,用于稳定的基线全球模型.
- 使用异步更新方法,对客户端老化延迟因子进行调整聚合权重.
- 包含基于准确性的决策机制,以防止无效的全球模型的分布.
主要成果:
- SaAS-FL显示了高的通信效率,并保持了高的模型准确性.
- 该算法在多样化,异构的数据环境中显示出强大的稳定性和适应性.
- 有效地减轻过时客户对模型性能的不利影响.
结论:
- SaAS-FL提供了一种新的方法,通过优化通信和准确性之间的权衡来提高FL效率.
- 拟议的方法为开发更高效,更强大的FL系统提供了宝贵的见解.
- 基于准确性的决策机制有效地防止了全球模型的退化.
相关概念视频
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Aggregates Classification
956
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
956
Cluster Sampling Method
13.9K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
13.9K
Observational Learning
802
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
802
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
267
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
267
Distributed Loads: Problem Solving
1.1K
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
1.1K
