相关实验视频
Updated: Jun 3, 2025

04:48
Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
Published on: July 5, 2024
367
适应性提示选择为DAG-Shard-based联合学习,具有高并发性和公平性
Ruiqi Xiao1, Yun Cao1, Bin Xia1
1School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China.
Sensors (Basel, Switzerland)
|January 11, 2025
概括
本研究介绍了基于DAG-Shard的联合学习 (DSFL),增强了大型模型的培训并发性. 与现有的DAG-FL和Blockchain-FL方法相比,DSFL提高了准确性和F1得分,确保了公平性和稳定性.
科学领域:
- 机器学习 机器学习
- 分布式系统 分布式系统
- 人工智能的人工智能
背景情况:
- 联合学习面临的挑战是对大型模型和大数据的高同步培训.
- 像定向环形图 (DAG) 和分片等现有的替代方案缺乏详细的共识设计和分片大小影响分析.
- 基于区块链的联合学习在训练并发方面存在局限性.
研究的目的:
- 通过结合DAG和分片方法,提高联合学习中的培训并发性和绩效.
- 研究共识算法和碎片大小对联合学习的影响.
- 开发一种适应性算法,以提高训练性能和同时控制DAG结构.
主要方法:
- 结合DAG和分片技术进行联合学习.
- 设计三个提示选择共识算法和一个自适应算法.
- 实施激励机制,以验证模型的公平性和稳定性.
- 调整分片和算法参数,以同时控制DAG规模.
主要成果:
- 与DAG-FL相比,DSFL在准确度 (8.19-12.21%) 和F1得分 (7.27-11.73%) 中显著改善.
- 与Blockchain-FL.相比,DSFL显示了准确度的提高 (7.82-11.86%) 和F1得分的改善 (8.89-13.27%).
- 拟议的模型在平衡和不平衡的数据集上都胜过DAG-FL和链-FL,证明了它的有效性.
结论:
- 基于DAG-Shard的联合学习 (DSFL) 在高同步场景中提供了卓越的性能.
- 与现有的联合学习方法相比,DSFL提供了更高的公平性和稳定性.
- 适应算法和并发控制机制有效地管理DAG规模并改善培训结果.
相关概念视频
Parallel Processing
145
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
145
Improving Translational Accuracy
8.7K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
8.7K
Associative Learning
287
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
287
Cluster Sampling Method
11.6K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
11.6K
Maximum Size of Aggregate
75
The maximum size of aggregate is defined as the aperture of the sieve retaining 15 percent or more of the particles present in the aggregate sample. The aggregate's maximum size impacts the concrete's water requirement, workability, and strength. Larger aggregates reduce the surface area needing cement paste coverage, which can lower water needs, thereby allowing a decrease in the water-to-cement ratio when the desired workability and richness of the mix are to be maintained, which can...
75
Differential Leveling
136
Differential leveling is a precise method in surveying used to determine the elevation difference between two points. Its primary goal is to establish accurate vertical measurements to create level surfaces or grade lines critical for designing and constructing infrastructures such as roads, bridges, and buildings.The procedure for differential leveling begins with setting up and leveling the instrument at a point where the benchmark can be seen. The level rod is held on the benchmark (BM), and...
136

