铁:一个开放的,安全的,公平的,去中心化的联合学习.
IEEE transactions on neural networks and learning systems
|November 21, 2023
概括
铁是一个新的联合学习 (FL) 框架,它消除了使用DAG结构的中央协调员,以实现完全分散的操作. 它确保了开放网络的公平性和安全性,优于现有的FL系统.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 联合学习 (FL) 保护数据隐私,但面临诸如网络异步和缺乏公平激励等挑战.
- 现有的FL框架通常依赖于中央协调员,限制了去中心化和可扩展性.
研究的目的:
- 引入IronForge,这是一个新一代的FL框架,旨在在开放网络中实现完全分散,安全和公平的操作.
- 解决当前FL架构的局限性,包括中央依赖和激励机制.
主要方法:
- 开发了一个以定向非循环图 (DAG) 为基础的结构,其中模型是节点,关系指导聚合,从而实现分散控制.
- 在DAG内部实施基于国家一致性的公平激励机制.
- 针对FL对隐私和激励公平性的攻击,整合专门的防御策略.
主要成果:
- 与现有的FL框架相比,IronForge在使用FLSim的实验评估中表现出优越的性能,公平性和安全性.
- 基于DAG的方法成功地消除了对中央协调员的需求,实现了完全分散的操作.
- 激励机制被证明是有效的,特别是在训练资源分布不均的网络中.
结论:
- 作为开放网络的第一个安全和完全分散的FL框架,IronForge代表了重大进步.
- 该框架适用于现实的网络和培训环境,为保护隐私的分布式学习提供了强大的解决方案.
相关概念视频
Observational Learning
186
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
186
Associative Learning
407
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
407
Cognitive Learning
246
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
246
Introduction to Learning
445
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
445
Ferromagnetism
2.4K
Materials like iron, nickel, and cobalt consist of magnetic domains, within which the magnetic dipoles are arranged parallel to each other. The magnetic dipoles are rigidly aligned in the same direction within a domain by quantum mechanical coupling among the atoms. This coupling is so strong that even thermal agitation at room temperature cannot break it. The result is that each domain has a net dipole moment. However, some materials have weaker coupling, and are ferromagnetic at lower...
2.4K
Reinforcement
217
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
217


