Ada‐FFL: Adaptive computing fairness federated learning

Author:

Cong Yue1ORCID,Qiu Jing12ORCID,Zhang Kun34,Fang Zhongyang1,Gao Chengliang1,Su Shen1,Tian Zhihong1

Affiliation:

1. The Cyberspace Institute of Advanced Technology Guangzhou University Guangzhou China

2. Pengcheng Lab Shenzhen China

3. Carnegie Mellon University Pittsburgh Pennsylvania USA

4. Mohamed Bin Zayed University of Artificial Intelligence Abu Dhabi United Arab Emirates

Abstract

AbstractAs the scale of federated learning expands, solving the Non‐IID data problem of federated learning has become a key challenge of interest. Most existing solutions generally aim to solve the overall performance improvement of all clients; however, the overall performance improvement often sacrifices the performance of certain clients, such as clients with less data. Ignoring fairness may greatly reduce the willingness of some clients to participate in federated learning. In order to solve the above problem, the authors propose Ada‐FFL, an adaptive fairness federated aggregation learning algorithm, which can dynamically adjust the fairness coefficient according to the update of the local models, ensuring the convergence performance of the global model and the fairness between federated learning clients. By integrating coarse‐grained and fine‐grained equity solutions, the authors evaluate the deviation of local models by considering both global equity and individual equity, then the weight ratio will be dynamically allocated for each client based on the evaluated deviation value, which can ensure that the update differences of local models are fully considered in each round of training. Finally, by combining a regularisation term to limit the local model update to be closer to the global model, the sensitivity of the model to input perturbations can be reduced, and the generalisation ability of the global model can be improved. Through numerous experiments on several federal data sets, the authors show that our method has more advantages in convergence effect and fairness than the existing baselines.

Funder

National Natural Science Foundation of China

Publisher

Institution of Engineering and Technology (IET)

Subject

Artificial Intelligence,Computer Networks and Communications,Computer Vision and Pattern Recognition,Human-Computer Interaction,Information Systems

Reference28 articles.

1. A survey on deep learning based knowledge tracing

2. A Survey on Access Control in the Age of Internet of Things

3. Mcmahan H.B. et al.:Communication‐Efficient learning of deep networks from decentralized data[J]. (2016)

4. Zhao Y. et al.:Federated learning with non‐iid data[J]. arXiv preprint arXiv:1806.00582 (2018)

Cited by 2 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3