分散聚合重量优化的分散联合学习
IEEE transactions on pattern analysis and machine intelligence
|December 5, 2025
概括
本研究介绍了一种用于分散式联合学习 (DFL) 的新型分布式算法,以优化聚合权重. 这种方法可以在没有中央协调的情况下,在边缘设备上实现高效,真正分布的模型训练.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 分布式系统 分布式系统
背景情况:
- 分散的联合学习 (DFL) 能够通过设备对设备 (D2D) 通信在边缘设备上进行协作模型训练.
- 聚合重量对于DFL的效率和准确性至关重要,但通常需要中央协调.
研究的目的:
- 开发一种分布式算法,以优化DFL中的聚合权重.
- 为了使重量优化过程与DFL的分散性质保持一致.
主要方法:
- 为DFL开发了一个分布式聚合重量优化算法.
- 通过量化权重对分散网络的影响来分析趋同.
- 一个固有值优化问题是用基于子梯度的算法来制定和解决的.
主要成果:
- 拟议的算法使边缘设备能够仅使用局部信息来获得最佳的聚合重量.
- 优化,沟通和学习都是以分布式的方式进行的.
- 数字结果显示了该算法的优越性在实际DFL部署中.
结论:
- 真正分布式的DFL系统是通过完全分散的优化方法实现的.
- 该方法提高了DFL设置中的学习效率和准确性.
- 分布式算法有效地解决了集中式重量优化的局限性.
相关概念视频
Distributed Loads: Problem Solving
1.1K
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
1.1K
Distributed Loads
927
Distributed loads are a common type of load that engineers and scientists encounter in various practical situations. Distributed loads often refer to a type of load spread over a surface or a structure and can be modeled as continuous force per unit area.
For example, consider a bookshelf filled with books stacked vertically adjacent to each other. The weight of the books is evenly distributed over the length of the shelf. As a result, the pressure at different locations on the surface of the...
For example, consider a bookshelf filled with books stacked vertically adjacent to each other. The weight of the books is evenly distributed over the length of the shelf. As a result, the pressure at different locations on the surface of the...
927
Aggregates Classification
953
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
953
Weighted Mean
6.2K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
6.2K
Distribution Reliability and Automation
476
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
476
Maximum Size of Aggregate
512
The maximum size of aggregate is defined as the aperture of the sieve retaining 15 percent or more of the particles present in the aggregate sample. The aggregate's maximum size impacts the concrete's water requirement, workability, and strength. Larger aggregates reduce the surface area needing cement paste coverage, which can lower water needs, thereby allowing a decrease in the water-to-cement ratio when the desired workability and richness of the mix are to be maintained, which can...
512
