Related Experiment Videos
Fedflow: cloud orchestration for federated learning with the FeatureCloud platform
Lukas Weilguny1,2, Niklas Probul3, Yani Ren1
1Université Paris-Saclay, INRAE, MGP, Jouy-en-Josas, F-78350, France.
Motivation:
Federated learning (FL) enables collaborative model training on geographically distributed genomic and clinical datasets while complying with data privacy laws and regulatory constraints. FeatureCloud is an existing platform for FL that provides an accessible web-based interface and a large repository of implemented methods. However, due to its graphical interface, FeatureCloud requires manual interaction of all participants, limiting automation, iteration, and reproducibility.
Results:
We introduce fedflow, a Python-based command-line tool for headless orchestration of FL tasks with FeatureCloud. This tool uses distributed computing resources such as virtual machines or cloud instances to automate such workflows. This allows for scalable federated computing either in local simulations or deployed in a trusted environment. Further, we demonstrate how fedflow can be used to integrate FeatureCloud in reproducible Snakemake workflows. For this, we reanalyse a metagenomic dataset with two federated algorithms and compare the results to the centralized approach with pooled data. Overall, fedflow enables automation of multi-client FL tasks, facilitates embedding of FeatureCloud in standard bioinformatics pipelines and thereby helps increase reproducibility.
Availability:
Fedflow is open-source and available at https://github.com/W-L/fedflow.
Related Concept Videos
Flow Cytometry
In...
Uniform Depth Channel Flow
Laminar Flow: Problem Solving
Uniform Depth Channel Flow: Problem Solving
Laminar Flow
Rapidly Varying Flow