Affiliation:
1. Department of Computer Science, Georgia State University, Atlanta, GA 30303, USA
2. Department of Computer Science, Sangmyung University, Seoul, Republic of Korea
Abstract
Since the concept of federated learning (FL) was proposed by Google in 2017, many applications have been combined with FL technology due to its outstanding performance in data integration, computing performance, privacy protection, etc. However, most traditional federated learning-based applications focus on image processing and natural language processing with few achievements in graph neural networks due to the graph’s nonindependent identically distributed (IID) nature. Representation learning on graph-structured data generates graph embedding, which helps machines understand graphs effectively. Meanwhile, privacy protection plays a more meaningful role in analyzing graph-structured data such as social networks. Hence, this paper proposes PPFL-GNN, a novel privacy-preserving federated graph neural network framework for node representation learning, which is a pioneer work for graph neural network-based federated learning. In PPFL-GNN, clients utilize a local graph dataset to generate graph embeddings and integrate information from other collaborative clients to utilize federated learning to produce more accurate representation results. More importantly, by integrating embedding alignment techniques in PPFL-GNN, we overcome the obstacles of federated learning on non-IID graph data and can further reduce privacy exposure by sharing preferred information.
Funder
National Science Foundation
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Information Systems
Reference37 articles.
1. Federated learning: strategies for improving communication efficiency;J. Konečný,2016
2. A comprehensive survey on graph neural networks;Z. Wu;IEEE Transactions on Neural Networks and Learning Systems,2021
3. Fairness amidst non-IID graph data: a literature review;W. Zhang,2022
4. Effective training strategies for deep graph neural networks;K. Zhou,2020
5. Sparse Graph Attention Networks