在客户级别差异性隐私下,在联合学习中实现更平坦的景观和更好的泛化
IEEE transactions on pattern analysis and machine intelligence
|August 11, 2025
概括
我们介绍DP-FedSAM和DP-FedSAM-topk,这是私人联合学习 (FL) 的新算法. 这些方法提高了模型的稳定性,并减少了差异隐私 (DP) 引起的性能退化.
科学领域:
- 机器学习 机器学习
- 网络安全 网络安全
- 分布式系统 分布式系统
背景情况:
- 联合学习 (FL) 允许在不共享原始数据的情况下进行协作模式培训.
- 客户端级别的差异化私有FL (DPFL) 是隐私的标准,但由于噪音更新导致性能下降.
- 现有的DPFL方法与急性损失景观和低质量扰动稳定性作斗争.
研究的目的:
- 提出新的DPFL算法,以减轻差异隐私造成的性能下降.
- 提高DPFL模型对抗噪声和干扰的稳定性和强度.
- 在私人联合学习中实现最先进的性能.
主要方法:
- 引入了DP-FedSAM,将度意识最小化 (SAM) 优化器集成到DPFL中.
- 开发了DP-FedSAM-topk,其中包含了局部更新散射,以减少噪声大小.
- 进行了理论分析,包括收,Renni DP,灵敏度和概括.
主要成果:
- DP-FedSAM产生更平坦,更稳定的局部模型,提高DP噪声和干扰的稳定性.
- DP-FedSAM-topk通过分散本地更新,减少噪音影响,进一步提高性能.
- 理论分析证实了算法能够减轻DP诱导的性能下降的能力.
- 经验结果表明,与现有的DPFL基线相比,它具有最先进的性能.
结论:
- DP-FedSAM和DP-FedSAM-topk有效地解决了DPFL的性能下降问题.
- 提出的方法提供了更好的稳定性,稳定性和隐私保证.
- 这些算法代表了实现高性能,私有联合学习的重大进步.
相关概念视频
Differential Leveling
308
Differential leveling is a precise method in surveying used to determine the elevation difference between two points. Its primary goal is to establish accurate vertical measurements to create level surfaces or grade lines critical for designing and constructing infrastructures such as roads, bridges, and buildings.The procedure for differential leveling begins with setting up and leveling the instrument at a point where the benchmark can be seen. The level rod is held on the benchmark (BM), and...
308
Difference from Background: Limit of Detection
7.1K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
7.1K
Survival Tree
159
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
159
Reducing Line Loss
193
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
193
Generalization, Discrimination, and Extinction
788
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
788
Improving Translational Accuracy
11.9K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.9K

