适应式联合集群用于分散的大数据平台上的不确定性意识学习
1Computer Department, Applied College, Jazan University, Jazan City, Saudi Arabia.
PloS one
|December 1, 2025
概括
适应式联合集群 (AFC) 通过提高准确性和降低通信成本来提高联合学习 (FL) 的可扩展性. 这种新的框架为分散的大数据应用程序提供了更大的强度来抵御后门攻击.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 分散式系统 分散式系统 分散式系统
背景情况:
- 联合学习 (FL) 在分散的大数据环境中面临着可扩展性问题,原因是数据异质性,通信限制和计算低效率.
- 现有的FL方法往往难以在各种数据集和网络条件之间平衡性能,通信开销和融合速度.
研究的目的:
- 引入适应式联合集群 (AFC),这是一个新的框架,旨在克服联合学习固有的可扩展性挑战.
- 提高分散的大数据平台上联合学习的效率,稳定性和准确性.
主要方法:
- 开发了AFC框架,基于计算能力和数据相关性进行自适应的客户端选择.
- 在客户端集群中实现了对本地化模型更新的层次聚合.
- 采用稀疏性和量子化技术,以实现高效的模型压缩.
主要成果:
- 与FedAvg相比,AFC在多个数据集 (CIFAR-10,CIFAR-100,时尚-MNIST,MIMIC-III) 中显示了4.3%的精度增加.
- 实现了49%的通信成本降低和35%更快的融合率.
- 对后门攻击表现出增强的稳定性,精度降低仅为2.8%,而FedAvg.的精度降低为7%.
结论:
- AFC显著提高了联合学习的可扩展性,稳定性和效率,超过了现有的算法.
- 该框架显示了安全的协作学习在资源有限,异质的环境,如医疗保健和物联网的实际价值.
- 未来的工作可能会解决网络连接假设,并纳入细粒度的个性化功能.
相关概念视频
Cluster Sampling Method
13.9K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
13.9K
Distributed Loads: Problem Solving
1.1K
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
1.1K
Uncertainty: Overview
1.5K
In analytical chemistry, we often perform repetitive measurements to detect and minimize inaccuracies caused by both determinate and indeterminate errors. Despite the cares we take, the presence of random errors means that repeated measurements almost never have exactly the same magnitude. The collective difference between these measurements - observed values - and the estimated or expected value is called uncertainty. Uncertainty is conventionally written after the estimated or expected value.
1.5K
Propagation of Uncertainty from Random Error
1.6K
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
1.6K
Uncertainty: Confidence Intervals
10.1K
The confidence interval is the range of values around the mean that contains the true mean. It is expressed as a probability percentage. The interpretation of a 95% confidence interval, for instance, is that the statistician is 95% confident that the true mean falls within the interval. The upper and lower limits of this range are known as confidence limits. The confidence limits for the true mean are estimated from the sample's mean, the standard deviation, and the statistical factor...
10.1K
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
