Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Associative Learning01:27

Associative Learning

619
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
619
Introduction to Learning01:18

Introduction to Learning

567
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
567
Aggregates Classification01:29

Aggregates Classification

397
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
397
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models01:06

Model Approaches for Pharmacokinetic Data: Distributed Parameter Models

134
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
134
Data: Types and Distribution01:19

Data: Types and Distribution

865
In biostatistics, data are the observations collected for analysis. There are two main types: parametric and non-parametric. Parametric data, which include continuous (e.g., weight) and discrete numerical data (e.g., number of tablets), assume a particular distribution pattern, often the normal distribution. Non-parametric data do not adhere to a specific distribution and typically comprise nominal (e.g., gender) and ordinal categorical data (e.g., pain scale ratings).
Distributions in...
865
Generalization, Discrimination, and Extinction01:24

Generalization, Discrimination, and Extinction

842
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
842

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A pan-cancer single-cell atlas uncovers the role of sex hormones and chromosomes in sex-divergent reprogramming of the tumor microenvironment.

Cell communication and signaling : CCS·2026
Same author

Mechanotransduction in glioma stem cell fate determination: from niche mechanics to therapeutic vulnerability and state plasticity.

Frontiers in cell and developmental biology·2026
Same author

Dialogue is Better Than Monologue: Instructing Medical LLMs via Strategical Conversation.

Proceedings of the conference. Association for Computational Linguistics. European Chapter. Conference·2026
Same author

WAT-to-BAT communication facilitates the sustained activation of BAT thermogenesis during cold exposure.

Cell discovery·2026
Same author

Sti1 participates in the dynamics of protein aggregation triggered by glucose signaling in <i>Saccharomyces cerevisiae</i>.

Acta biochimica et biophysica Sinica·2026
Same author

A small heat shock protein from Arabidopsis thaliana regulates glyceraldehyde-3-phosphate dehydrogenase in the drought tolerance.

Plant cell reports·2026
Same journal

What do LLMs value? An evaluation framework for revealing subjective trade-offs in assessment of glycemic control.

Proceedings of machine learning research·2026
Same journal

Towards the Efficient Inference by Incorporating Automated Computational Phenotypes under Covariate Shift.

Proceedings of machine learning research·2026
Same journal

Endo-SemiS: Towards Robust Semi-Supervised Image Segmentation for Endoscopic Video.

Proceedings of machine learning research·2026
Same journal

Perspective: Machine Learning for Health Should Consider Social Drivers of Health.

Proceedings of machine learning research·2026
Same journal

Classifying Phonotrauma Severity from Vocal Fold Images with Soft Ordinal Regression.

Proceedings of machine learning research·2026
Same journal

Does Domain-Specific Retrieval Augmented Generation Help LLMs Answer Consumer Health Questions?

Proceedings of machine learning research·2026
See all related articles

Related Experiment Video

Updated: Sep 25, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

610

Data-Free Knowledge Distillation for Heterogeneous Federated Learning.

Zhuangdi Zhu1, Junyuan Hong1, Jiayu Zhou1

  • 1Department of Computer Science and Engineering, Michigan State University, Michigan, USA.

Proceedings of Machine Learning Research
|April 28, 2022
PubMed
Summary
This summary is machine-generated.

Federated Learning (FL) faces challenges with heterogeneous users. This study introduces a data-free knowledge distillation method to improve model generalization and convergence speed in FL systems.

More Related Videos

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

702

Related Experiment Videos

Last Updated: Sep 25, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

610
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

702

Area of Science:

  • Artificial Intelligence
  • Machine Learning
  • Decentralized Systems

Background:

  • Federated Learning (FL) enables collaborative model training without sharing raw data.
  • User heterogeneity in FL leads to model drift and slow convergence.
  • Existing knowledge distillation methods require proxy datasets, limiting practicality.

Purpose of the Study:

  • To address the challenges of user heterogeneity in Federated Learning.
  • To propose a novel data-free knowledge distillation approach for FL.
  • To enhance the generalization performance and convergence speed of FL models.

Main Methods:

  • Developed a data-free knowledge distillation technique for heterogeneous FL.
  • Server learns a lightweight generator to ensemble user information without data.
  • Broadcasted distilled knowledge to local users to guide training as an inductive bias.

Main Results:

  • The proposed data-free knowledge distillation approach effectively handles user heterogeneity.
  • Achieved improved generalization performance in FL models.
  • Reduced the number of communication rounds required for convergence.

Conclusions:

  • The data-free knowledge distillation method offers a practical solution for heterogeneous FL.
  • This approach enhances model quality and training efficiency.
  • Outperforms state-of-the-art methods in addressing FL challenges.