Affiliation:
1. The Cyberspace Institute of Advanced Technology Guangzhou University Guangzhou China
2. Pengcheng Lab Shenzhen China
3. Carnegie Mellon University Pittsburgh Pennsylvania USA
4. Mohamed Bin Zayed University of Artificial Intelligence Abu Dhabi United Arab Emirates
Abstract
AbstractAs the scale of federated learning expands, solving the Non‐IID data problem of federated learning has become a key challenge of interest. Most existing solutions generally aim to solve the overall performance improvement of all clients; however, the overall performance improvement often sacrifices the performance of certain clients, such as clients with less data. Ignoring fairness may greatly reduce the willingness of some clients to participate in federated learning. In order to solve the above problem, the authors propose Ada‐FFL, an adaptive fairness federated aggregation learning algorithm, which can dynamically adjust the fairness coefficient according to the update of the local models, ensuring the convergence performance of the global model and the fairness between federated learning clients. By integrating coarse‐grained and fine‐grained equity solutions, the authors evaluate the deviation of local models by considering both global equity and individual equity, then the weight ratio will be dynamically allocated for each client based on the evaluated deviation value, which can ensure that the update differences of local models are fully considered in each round of training. Finally, by combining a regularisation term to limit the local model update to be closer to the global model, the sensitivity of the model to input perturbations can be reduced, and the generalisation ability of the global model can be improved. Through numerous experiments on several federal data sets, the authors show that our method has more advantages in convergence effect and fairness than the existing baselines.
Funder
National Natural Science Foundation of China
Publisher
Institution of Engineering and Technology (IET)
Subject
Artificial Intelligence,Computer Networks and Communications,Computer Vision and Pattern Recognition,Human-Computer Interaction,Information Systems
Reference28 articles.
1. A survey on deep learning based knowledge tracing
2. A Survey on Access Control in the Age of Internet of Things
3. Mcmahan H.B. et al.:Communication‐Efficient learning of deep networks from decentralized data[J]. (2016)
4. Zhao Y. et al.:Federated learning with non‐iid data[J]. arXiv preprint arXiv:1806.00582 (2018)
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献