Affiliation:
1. School of Computer and Information Engineering, Henan University, Kaifeng 475001, China
2. School of Software, Henan University, Kaifeng 475001, China
Abstract
Federated learning (FL), a distributed machine-learning framework, is poised to effectively protect data privacy and security, and it also has been widely applied in variety of fields in recent years. However, the system heterogeneity and statistical heterogeneity of FL pose serious obstacles to the global model’s quality. This study investigates server and client resource allocation in the context of FL system resource efficiency and offers the FedAwo optimization algorithm. This approach combines adaptive learning with federated learning, and makes full use of the computing resources of the server to calculate the optimal weight value corresponding to each client. This approach aggregated the global model according to the optimal weight value, which significantly minimizes the detrimental effects of statistical and system heterogeneity. In the process of traditional FL, we found that a large number of client trainings converge earlier than the specified epoch. However, according to the provisions of traditional FL, the client still needs to be trained for the specified epoch, which leads to the meaningless of a large number of calculations in the client. To further lower the training cost, the augmentation FedAwo
algorithm is proposed. The FedAwo
algorithm takes into account the heterogeneity of clients and sets the criteria for local convergence. When the local model of the client reaches the criteria, it will be returned to the server immediately. In this way, the epoch of the client can dynamically be modified adaptively. A large number of experiments based on MNIST and Fashion-MNIST public datasets reveal that the global model converges faster and has higher accuracy in FedAwo and FedAwo
algorithms than FedAvg, FedProx, and FedAdp baseline algorithms.
Funder
Major Science and Technology Special Project of Henan Province
Subject
General Mathematics,General Medicine,General Neuroscience,General Computer Science
Reference35 articles.
1. Communicationefficient learning of deep networks from decentralized data;B. McMahan,2017
2. Federated optimization in heterogeneous networks;T. Li;Proceedings of Machine Learning and Systems,2020
3. Hey siri: an ondevice dnnpowered voice trigger for apple’s personal assistant;S. Team;Apple Machine Learning Journal,2017
4. Stochastic optimization with importance sampling for regularized loss minimization;P. Zhao,2015
5. Fast-Convergent Federated Learning
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献