Swarm-FHE:针对恶意客户端的基于完全同态加密的Swarm学习
Hussain Ahmad Madni1, Rao Muhammad Umer2,3, Gian Luca Foresti1
1Department of Mathematics, Computer Science and Physics (DMIF), University of Udine, Udine 33100, Italy.
International journal of neural systems
|May 29, 2023
概括
使用完全同型加密 (Swarm-FHE) 的Swarm学习通过加密模型参数来提高协作AI培训中的隐私. 这种方法可以防止恶意参与者和梯度泄漏,改善安全分布式学习.
科学领域:
- 人工智能的人工智能
- 网络安全 网络安全
- 分布式系统 分布式系统
背景情况:
- 群体学习 (SL) 可以在没有中央服务器的情况下实现协作模型训练,但由于数据敏感性和GAN等神经网络的潜在梯度泄漏,它面临隐私挑战.
- 现有的SL框架使用区块链进行安全聚合,但仍然容易受到损害的参与者,他们可以操纵他人的隐私.
- 从模型参数重建原始数据的风险需要在分布式学习中使用先进的隐私保护技术.
研究的目的:
- 提出和评估Swarm-FHE,这是一种将Swarm Learning与完全同型加密 (FHE) 集成的新方法,以解决协作AI培训中的隐私问题.
- 加强分布式模型训练对恶意参与者和梯度泄漏的安全性.
- 在加密环境中利用区块链进行参与者身份验证和安全参数共享.
主要方法:
- 实现了Swarm-FHE,这是一个使用完全同型加密 (FHE) 加密模型参数的框架,然后在Swarm学习环境中的参与者之间共享它们.
- 利用区块链技术在Swarm学习网络中安全注册和验证参与者.
- 通过在CIFAR-10和MNIST数据集上训练卷积神经网络,并测试各种超参数设置,评估了该方法的有效性.
主要成果:
- Swarm-FHE成功地加密模型参数,防止梯度泄露和恶意参与者操纵隐私.
- 拟议的方法在安全的协作培训场景中,与现有方法相比,表现优越.
- 在CIFAR-10和MNIST数据集上的实验验验证了Swarm-FHE在不同配置下的有效性和稳定性.
结论:
- 通过结合Swarm学习,完全同型加密和区块链技术,Swarm-FHE为保护隐私的协作AI培训提供了强大的解决方案.
- 在分布式学习环境中,FHE的集成有效地减轻了与数据敏感性和恶意行为者相关的风险.
- 这种方法显著提高了分散式机器学习应用程序的安全和隐私标准.
相关概念视频
Masking and Demasking Agents
2.5K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.5K
Leaky Scanning
5.2K
During most eukaryotic translation processes, the small 40S ribosome subunit scans an mRNA from its 5' end until it encounters the first start AUG codon. The large 60S ribosomal subunit then joins the smaller one to initiate protein synthesis. The location of the translation initiation is largely determined by the nucleotides near the start codon as there may be multiple translation initiation sites present on the mRNA. Marilyn Kozak discovered that the sequence RCCAUGG (where R...
5.2K
Avoidance Learning and Learned Helplessness
1.8K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.8K
Associative Learning
465
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
465
Purposive Learning
169
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
169
Multimachine Stability
200
Multimachine stability analysis is crucial for understanding the dynamics and stability of power systems with multiple synchronous machines. The objective is to solve the swing equations for a network of M machines connected to an N-bus power system.
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
200


