Learning from Feature and Global Topologies: Adaptive Multi-View Parallel Graph Contrastive Learning
-
Published:2024-07-21
Issue:14
Volume:12
Page:2277
-
ISSN:2227-7390
-
Container-title:Mathematics
-
language:en
-
Short-container-title:Mathematics
Author:
Song Yumeng1, Li Xiaohua1, Li Fangfang1ORCID, Yu Ge1ORCID
Affiliation:
1. School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China
Abstract
To address the limitations of existing graph contrastive learning methods, which fail to adaptively integrate feature and topological information and struggle to efficiently capture multi-hop information, we propose an adaptive multi-view parallel graph contrastive learning framework (AMPGCL). It is an unsupervised graph representation learning method designed to generate task-agnostic node embeddings. AMPGCL constructs and encodes feature and topological views to mine feature and global topological information. To encode global topological information, we introduce an H-Transformer to decouple multi-hop neighbor aggregations, capturing global topology from node subgraphs. AMPGCL learns embedding consistency among feature, topology, and original graph encodings through a multi-view contrastive loss, generating semantically rich embeddings while avoiding information redundancy. Experiments on nine real datasets demonstrate that AMPGCL consistently outperforms thirteen state-of-the-art graph representation learning models in classification accuracy, whether in homophilous or non-homophilous graphs.
Reference61 articles.
1. Velickovic, P., Fedus, W., Hamilton, W.L., Liò, P., Bengio, Y., and Hjelm, R.D. (2019, January 6–9). Deep Graph Infomax. Proceedings of the ICLR, New Orleans, LA, USA. 2. Gong, X., Yang, C., and Shi, C. (2023, January 7–14). MA-GCL: Model augmentation tricks for graph contrastive learning. Proceedings of the AAAI, Washington, DC, USA. 3. Li, W.Z., Wang, C.D., Xiong, H., and Lai, J.H. (2023, January 6–10). Homogcl: Rethinking homophily in graph contrastive learning. Proceedings of the KDD, Long Beach, CA, USA. 4. Song, Y., Gu, Y., Li, T., Qi, J., Liu, Z., Jensen, C.S., and Yu, G. (2024). CHGNN: A semi-supervised contrastive hypergraph learning network. IEEE Trans. Knowl. Data Eng. 5. Kipf, T.N., and Welling, M. (2017, January 24–26). Semi-Supervised Classification with Graph Convolutional Networks. Proceedings of the ICLR, Toulon, France.
|
|