通过类原型相似性蒸和自适应面具来解决联合学习中的客户端漂移问题
IEEE transactions on cybernetics
|November 25, 2025
概括
联合学习 (FL) 性能因非IID数据导致客户端漂移而下降. 我们的FedCSD算法使用类原型相似性蒸来对齐模型,在非IID设置中显著提高FL性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 分布式系统 分布式系统
背景情况:
- 联合学习 (FL) 促进跨分布式客户端的协作模式培训,同时保持数据隐私.
- 客户之间非独立和相同分布的 (非IID) 数据会导致客户端漂移,降低FL模型的性能.
- 客户端漂移主要是由于灾难性遗忘导致本地和全球模型之间的逻辑差异增加.
研究的目的:
- 解决非IID数据导致的联合学习中的绩效下降问题.
- 提出一个新的算法,FedCSD,它对准了本地和全球模型逻辑.
- 在联合学习框架中提高知识转移的可靠性.
主要方法:
- 引入了FedCSD (联合类原型相似性蒸),以调整本地和全球模型逻辑.
- 利用局部逻辑和全球原型之间的相似性来改进全球逻辑并增强类相似性信息.
- 采用自适应面具来过不可靠的全球模型软标签,防止本地模型优化错误.
主要成果:
- 通过调整本地和全球模型逻辑,FedCSD有效地减轻了客户漂移.
- 拟议的方法提高了全球模型中类相似性信息的质量.
- 实验结果表明,FedCSD在非IID场景中优于最先进的FL方法.
结论:
- 在联邦学习中,FedCSD为非IID数据的挑战提供了一个强大的解决方案.
- 该算法通过解决灾难性遗忘和确保可靠的知识蒸来提高FL的性能.
- 这些发现突出了对调整模型逻辑对于在异质环境中有效的协作学习的重要性.
相关概念视频
Masking and Demasking Agents
3.4K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
3.4K
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K
Modeling and Similitude
569
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
569
Concepts and Prototypes
469
The human nervous system handles vast amounts of information by translating sensory stimuli into neural impulses, which the brain processes, creating thoughts expressed through language or stored as memories. The brain also synthesizes information from emotions and memories, which significantly influence thoughts and behaviors. This intricate process creates a comprehensive mental picture.
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
469
Causes of Similarity-Dissimilarity Effect
233
The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
233
