顶部k 混杂的差异性隐私联合学习,用于异质数据
Di Xiao1, Xinchun Fan1, Lvjun Chen1
1College of Computer Science, Chongqing University, Chongqing 400044, China.
Sensors (Basel, Switzerland)
|March 17, 2025
概括
联合学习 (FL) 有效地解决了数据异质性和隐私风险,使用了新的TopkSDP-FL框架. 这种方法提高了模型的准确性,并在分散的AI培训中显著降低了通信成本.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 数据 隐私 数据 隐私 数据
背景情况:
- 联合学习 (FL) 允许在不集中敏感数据的情况下进行协作模式培训.
- FL的主要挑战包括数据异质性,隐私漏洞和高通讯开销.
- 现有的保护隐私的FL方法与异质数据作斗争,导致通信成本增加.
研究的目的:
- 提出一个新的联合学习框架,TopkSDP-FL,专为异质数据环境设计.
- 加强隐私保证,减少FL的通信开销.
- 为了减轻分散培训场景中的模型漂移.
主要方法:
- 开发一个TopkSDP-FL框架,包括一个双向的topk通信机制.
- 引入一种以学习为灵感的对比性规范化,用于当地培训,以打击模式漂移.
- 实现层级梯度参数混合,以加强隐私和预算管理.
- 正式的隐私分析以确认隐私放大效应.
主要成果:
- 与最先进的FL方法相比,TopkSDP-FL表现优越,特别是在非IID (非独立和相同分布) 场景中.
- 与FedAvg和其他领先的算法相比,平均准确度提高了3%.
- 将通信成本降低了90%以上,同时提高了隐私保护.
结论:
- 拟议的TopkSDP-FL框架有效地解决了联合学习中的数据异质性和隐私问题.
- 这些新方法通过减少通讯开支,显著提高了效率.
- TopkSDP-FL提供了一个强大的解决方案,用于安全和高效的去中心化人工智能模型培训.
更多相关视频
10:13Simple and Fast Rolling Circle Amplification-Based Detection of Topoisomerase 1 Activity in Crude Biological Samples
Published on: December 2, 2022
2.5K
09:14Nanotopology of Cell Adhesion upon Variable-Angle Total Internal Reflection Fluorescence Microscopy VA-TIRFM
Published on: October 2, 2012
10.1K
相关概念视频
Rotation of Asymmetric Top
817
By definition, a spherically symmetric body has the same moment of inertia about any axis passing through its center of mass. This situation changes if there is no spherical symmetry. Since most rigid bodies are not spherically symmetric, these require special treatment.
The relationship between the angular momentum of any rigid body and its angular velocity, both of which are vectors, involves the moment of inertia. The moment of inertia is a scalar quantity only for spherically symmetric...
The relationship between the angular momentum of any rigid body and its angular velocity, both of which are vectors, involves the moment of inertia. The moment of inertia is a scalar quantity only for spherically symmetric...
817
Methods of Obtaining Topography
39
Topography involves measuring and mapping land elevations, natural features, and artificial structures to create accurate representations of the terrain. Topographic surveying relies on traditional and modern methods, each with distinct advantages and limitations.Traditional Surveying Methods:Transit stadia surveys and plane table surveys were widely used traditional surveying methods. These techniques relied on instruments like theodolites and stadia rods for measuring distances and angles,...
39
The Proteasome
3.4K
3.4K
Positron Emission Tomography
3.9K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
3.9K
Telomeres and Telomerase
5.0K
5.0K
GTPases and their Regulation
2.2K
2.2K
