FederatedScope: A Flexible Federated Learning Platform for Heterogeneity-Reference-Cited by-同舟云学术

FederatedScope: A Flexible Federated Learning Platform for Heterogeneity

Published:2023-01 Issue:5 Volume:16 Page:1059-1072
ISSN:2150-8097
Container-title:Proceedings of the VLDB Endowment
language:en
Short-container-title:Proc. VLDB Endow.

Author:

Xie Yuexiang¹,Wang Zhen¹,Gao Dawei¹,Chen Daoyuan¹,Yao Liuyi¹,Kuang Weirui¹,Li Yaliang¹,Ding Bolin¹,Zhou Jingren¹

Affiliation:

1. Alibaba Group

Abstract

Although remarkable progress has been made by existing federated learning (FL) platforms to provide infrastructures for development, these platforms may not well tackle the challenges brought by various types of heterogeneity. To fill this gap, in this paper, we propose a novel FL platform, named FederatedScope, which employs an event-driven architecture to provide users with great flexibility to independently describe the behaviors of different participants. Such a design makes it easy for users to describe participants with various local training processes, learning goals and backends, and coordinate them into an FL course with synchronous or asynchronous training strategies. Towards an easy-to-use and flexible platform, FederatedScope enables rich types of plug-in operations and components for efficient further development, and we have implemented several important components to better help users with privacy protection, attack simulation and auto-tuning. We have released FederatedScope at https://github.com/alibaba/FederatedScope to promote academic research and industrial deployment of federated learning in a wide range of scenarios.

Publisher

Association for Computing Machinery (ACM)

Subject

General Earth and Planetary Sciences,Water Science and Technology,Geography, Planning and Development

Link

https://dl.acm.org/doi/pdf/10.14778/3579075.3579081

Reference96 articles.

1. Full version of paper FederatedScope: A Flexible Federated Learning Platform for Heterogeneity. https://arxiv.org/abs/2204.05011 Full version of paper FederatedScope: A Flexible Federated Learning Platform for Heterogeneity. https://arxiv.org/abs/2204.05011

2. The examples of cross-backend FL in FederatedScope. https://github.com/alibaba/FederatedScope/tree/master/federatedscope/cross_backends The examples of cross-backend FL in FederatedScope. https://github.com/alibaba/FederatedScope/tree/master/federatedscope/cross_backends

3. The examples of multiple learning goals FL in FederatedScope. https://github.com/alibaba/FederatedScope/tree/master/benchmark/B-FHTL The examples of multiple learning goals FL in FederatedScope. https://github.com/alibaba/FederatedScope/tree/master/benchmark/B-FHTL

4. Takuya Akiba , Shotaro Sano , Toshihiko Yanase , Takeru Ohta , and Masanori Koyama . 2019 . Optuna: A next-generation hyperparameter optimization framework . In Proc. of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'19) . 2623--2631. Takuya Akiba, Shotaro Sano, Toshihiko Yanase, Takeru Ohta, and Masanori Koyama. 2019. Optuna: A next-generation hyperparameter optimization framework. In Proc. of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'19). 2623--2631.

5. Muhammad Asad , Ahmed Moustafa , and Takayuki Ito . 2020. FedOpt: Towards Communication Efficiency and Privacy Preservation in Federated Learning. Applied Sciences 10, 8 ( 2020 ). Muhammad Asad, Ahmed Moustafa, and Takayuki Ito. 2020. FedOpt: Towards Communication Efficiency and Privacy Preservation in Federated Learning. Applied Sciences 10, 8 (2020).

Cited by 27 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Federated learning secure model: A framework for malicious clients detection;SoftwareX;2024-09

2. FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning;Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining;2024-08-24

3. FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model;Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining;2024-08-24

4. On the Convergence of Zeroth-Order Federated Tuning for Large Language Models;Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining;2024-08-24

5. VertiMRF: Differentially Private Vertical Federated Data Synthesis;Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining;2024-08-24