EF-Feddr:使用Douglas-Rachford分割和错误反进行沟通高效的联合学习
Jiao Xue1, Chundong Wang1,2
1School of Computer Science and Engineering, Tianjin University of Technology, Tianjin, China.
Frontiers in artificial intelligence
|February 13, 2026
概括
我们推出EF-Feddr,这是一种高效的通信联合学习算法,可以提高培训速度和可扩展性. 它克服了数据压缩引起的融合问题,使联合学习变得更加实用.
科学领域:
- 分布式机器学习 分布式机器学习
- 优化算法 优化算法
背景情况:
- 联合学习 (FL) 面临着影响效率的沟通瓶.
- 非IID数据和频繁的客户端-服务器通信阻碍了FL的可扩展性.
研究的目的:
- 提出EF-Feddr,一个用于联邦复合材料优化的通信效率高的算法.
- 用非IID数据和偏向压缩来解决FL的挑战.
主要方法:
- 基于放松的道格拉斯-拉赫福德分裂开发了EF-Feddr.
- 集成的错误反 (EF) 以确保与偏向压缩的融合.
主要成果:
- EF-Feddr实现了O(1/K) 的收率和O(1/ε^2) 的通信复杂性.
- 对女权主义者,莎士比亚和合成数据的实验验验证了EF-Feddr的有效性.
结论:
- EF-Feddr有效地克服了来自偏向压缩的收退化.
- 该算法为通信受约束的联合学习提供了实用解决方案.
相关概念视频
Communication
8.8K
Communication between two animals occurs when one animal transmits an information signal that causes a change in the animal that receives the information. Organisms communicate with one another in a host of different ways. Signals can be auditory, chemical, visual, tactile, or a combination of these. Communication is a critical behavioral adaptation that promotes survival, growth, and reproduction.
8.8K
Communication
11.7K
Sharing information, concepts, and emotions to foster mutual understanding is communication. The sender, recipient, and transaction must be considered in this manner. The sender is the person who shares the message, the recipient is the person who receives and understands the message, and the transaction is the method used to deliver the message and the variables that affect the communication's context and surroundings. The nurse-client connection is built on therapeutic communication.
11.7K
Feedback Inhibition
57.3K
Biochemical reactions are occurring constantly in cells, converting starting substances to different products, usually with the help of enzymes that speed the reactions. Without enzymes, it would take far too long for most reactions to occur to be useful to the cell!
57.3K
Feedback Loops
64.7K
In most cases, excessive hormone production is prevented by negative feedback—a loop that starts with a stimulus inducing the release of a particular substance, like a hormone, to maintain a certain level before triggering a signal that results in a decrease in further release of the hormone.
64.7K
Systematic Error: Methodological and Sampling Errors
11.1K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
11.1K
Fundamental Attribution Error
13.8K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
13.8K


