Related Experiment Videos
SCKM: Symmetric Co-Skew Moment for User Selection in Federated Learning
Liangyan Li1,2, Yangyi Liu2, Yimo Ning3
1Huawei Technologies Co., Ltd., Waterloo, ON N2J 4PP, Canada.
Abstract:
We introduce the symmetric co-skewness moment (SCKM)-a third-order informational dissimilarity metric that consistently outperforms state-of-the-art client-selection heuristics in federated learning (FL) under heterogeneous data. Unlike similarity-driven schemes, SCKM minimizes redundancy by favoring clients with complementary gradients, delivering faster and more stable convergence even at high heterogeneity levels. Operating on highly compressed 0.5% gradient summaries, our framework provides two operating modes for different deployment scales: (i) SCKM-Select directly ranks and schedules a small candidate pool, whereas (ii) SCKM-Cluster adds a fast, elbow-guided clustering step to scalably choose from thousands of users. We evaluate both variants on a VGG-16 model across multiple non-IID partition schemes and initializations, observing consistent gains over leading cosine-similarity, loss-sketch, and max-diversity baselines-without increasing the communication budget.
Related Concept Videos
Skewness
The longer the tail of the plot on one side, the more skewed it is. The skewness of a data set’s values suggests that the measures of central tendency are...
Types of Skewness
For instance, in the middle of a pandemic, the geographical distribution of vaccine coverage may be positively skewed towards populations in the global north countries. However,...
Cluster Sampling Method
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
Moment of Inertia about an Arbitrary Axis
In this scenario, the perpendicular distance between the chosen arbitrary axis...
Moment of Inertia
If a rigid body is rotating about an axis but is not in translational motion, its translational kinetic energy is zero. However, since each particle undergoes rotational motion, it possesses non-zero velocity and kinetic energy. Thus, the kinetic energy of the rigid body, which is the sum of the...
Symmetric Member in Bending