FedHyperGraph: 一个层级的个性化联合学习,在超标空间中使用相关性图表
Haizhou Du1, Chongyi Qiu1, Huan Huo2
1Shanghai University of Electric Power, China.
概括
本研究介绍了FedHyperGraph,这是个性化联合学习 (PFL) 的新框架. FedHyperGraph通过捕捉超标空间中的层级相关性来提高模型个性化,在准确性和融合速度方面超过现有方法.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 分布式系统 分布式系统
背景情况:
- 个性化联合学习 (PFL) 旨在在异质数据场景中实现模型个性化.
- 当前的PFL方法往往以单一的方式汇总模型参数,忽视关键的跨客户端参数相关性.
- 这种粗的方法限制了个性化的有效性,当客户有类似的任务,但不同的数据.
研究的目的:
- 提出FedHyperGraph,一个图形导向的聚合框架,用于层层的PFL.
- 解决现有的PFL方法中单立式参数聚合的局限性.
- 利用跨客户端参数之间的潜在相关性来增强个性化.
主要方法:
- 开发了FedHyperGraph,这是一个利用层级知识的框架.
- 在超标空间中构建潜相关图,以指导聚合.
- 实施了以图形为指导的聚合过程,以进行个性化的模型更新.
主要成果:
- FedHyperGraph实现了显著的准确性改进:在图形上达到42.6%,在计算机视觉 (CV) 上达到33.1%,在自然语言处理 (NLP) 数据集上达到7.5%.
- 在简历任务上,加速融合率高达52.6%.
- 在各种客户端规模上展示了卓越的可扩展性.
结论:
- FedHyperGraph有效地捕捉了高级PFL的层级知识和潜在相关性.
- 超标空间表示增强了个性化的聚合过程.
- 对于PFL来说,FedHyperGraph在准确性,收性和可扩展性方面提供了显著的改进.
相关概念视频
Graphs of Polar Equations
204
The polar coordinate system represents points using a distance from a central point (the pole) and an angle from a reference direction (the polar axis). Unlike rectangular coordinates, polar coordinates are ideal for graphing curves with radial symmetry or periodic behavior.Some general forms of graphs in polar coordinates include the following:Equation of a Circle (Centered at the Pole):A graph where the radius remains constant for all angles traces a circle centered at the pole:Equation of a...
204
Geometry of Hyperbolas
345
A hyperbola consists of all points where the absolute difference of distances to two fixed points, called foci, remains constant. The standard equation isEach branch extends infinitely and approaches two asymptotes, which guide the curve’s behavior. The parameters a and b define key features: a measures the distance from the center to each vertex along the transverse axis, while b influences the slopes of the asymptotes. The asymptotes have equationsA rectangle centered at the origin with...
345
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Graphs of Equations in Two Variables
155
An equation with two variables, typically written in the form y = f(x) or Ax + By = C, describes a relationship between quantities represented by x and y. Each solution to such an equation is an ordered pair (x, y) that satisfies the equation when substituted. These pairs can be represented graphically to understand the variables' relationship visually.A common technique for constructing the graph of a two-variable equation is to create a value table. Begin by choosing several values for the...
155
Graphs of Functions
210
Graphs of functions provide a visual representation of how output values change in response to varying inputs. Each point on the graph corresponds to an ordered pair, where the x-coordinate (independent variable) determines the horizontal position and the y-coordinate (dependent variable) determines the vertical position. Linear functions like y = x give a straight line, indicating a constant rate of change.Nonlinear functions display more complex behaviors. Even power functions generate...
210
Vector Algebra: Graphical Method
16.6K
Vectors can be multiplied by scalars, added to other vectors, or subtracted from other vectors. The vector sum of two (or more) vectors is called the resultant vector or, for short, the resultant.
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
16.6K


