在通信错误下路线和聚合分散的联合学习
IEEE transactions on neural networks and learning systems
|April 15, 2025
概括
路由和聚合 (R&A) 分散的联合学习 (D-FL) 通过通过既定的路径有效地路由数据来提高模型训练的准确性. 这种方法优于传统的八协议,特别是在没有参与节点的网络中.
科学领域:
- 机器学习 机器学习
- 分布式系统 分布式系统
- 网络通讯 网络通讯 网络通讯
背景情况:
- 分散的联合学习 (D-FL) 提供可扩展的本地模型聚合.
- 现有的D-FL方法经常使用低效的八协议,特别是当网络节点不是所有D-FL客户端时.
研究的目的:
- 引入一个新的D-FL战略,路线和聚合 (R&A) D-FL.
- 分析路由和通信错误对R&A D-FL融合的影响.
- 与现有方法相比,证明R&A D-FL的有效性.
主要方法:
- 开发了R&A D-FL,它使用已确定的路线进行模型交换,而不是洪水.
- 包含聚合系数的自适应规范化,以处理通信错误.
- 分析了基于端到端数据包错误率 (PERs) 的收性质.
主要成果:
- 在一个由10个客户组成的网络中,R&A D-FL在训练准确度上比基于洪水的D-FL提高了35%.
- 当使用具有最小端到端数据包错误率的路线时,收是最佳的.
- 随着路由节点的增加,R&A D-FL在通信错误下的准确性接近理想的集中式联合学习 (C-FL).
结论:
- R&A D-FL为分散的联合学习提供了一种更有效和更强大的方法.
- 该方法显示了D-FL和网络协议之间的显著协同作用.
- 在复杂的网络环境中,R&A D-FL有效地减轻了通信错误,提高了训练准确度.
相关概念视频
Propagation of Uncertainty from Random Error
570
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
570
Propagation of Uncertainty from Systematic Error
407
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
407
Associative Learning
246
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
246
Random and Systematic Errors
10.7K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
10.7K
Observational Learning
101
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
101
Aggregates Classification
290
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
290


