斯拉克联邦对抗性训练
IEEE transactions on pattern analysis and machine intelligence
|December 22, 2025
概括
由于数据异质性增加,联合对抗训练可能会降低准确性. 斯拉克联合对抗训练 (SFAT) 通过放松目标和使用加权聚合来改善联合模型中的稳健精度来减轻这一问题.
科学领域:
- 机器学习 机器学习
- 网络安全 网络安全
- 分布式系统 分布式系统
背景情况:
- 联合学习 (FL) 和对抗性培训 (AT) 对于强大的私有人工智能至关重要.
- 结合FL和AT可以导致后期培训阶段的准确性降低.
- 这种退化源于对抗性数据加剧了客户数据异质性.
研究的目的:
- 为了解决联邦对抗训练中的准确性退化.
- 提出一种新的框架,以打击数据异质性加剧.
- 在对抗性攻击下提高联合模型的强大准确性.
主要方法:
- 引入了一个alpha-slack机制来放松联邦对抗性训练目标.
- 开发了Slack联合对抗训练 (SFAT) 框架.
- 拟议的SFAT*对混合标准/对抗性培训客户进行分层聚合.
主要成果:
- 通过客户端智能的松和加权聚合,SFAT减轻了优化偏差.
- 理论分析证实了放松学习目标的趋同.
- 在各种数据集上的实验验证证明了对各种FL/AT方法的有效性.
结论:
- 拟议的SFAT框架有效地打击了联合对抗训练中数据异质性的加剧.
- 通过减轻优化偏差,SFAT提高了强大的准确性.
- 这些方法在不同的培训环境和数据集中是可通用的和有效的.
相关概念视频
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Observational Learning
782
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
782
Force Classification
2.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
2.2K
Avoidance Learning and Learned Helplessness
2.5K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.5K
Association Areas of the Cortex
8.7K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
8.7K
Introduction to Learning
884
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
884
