Beyond Weisfeiler–Lehman with Local Ego-Network Encodings

Author:

Alvarez-Gonzalez Nurudin1ORCID,Kaltenbrunner Andreas23ORCID,Gómez Vicenç1ORCID

Affiliation:

1. Department of Information and Communications Technologies, Universitat Pompeu Fabra, 08018 Barcelona, Spain

2. Internet Interdisciplinary Institute, Universitat Oberta de Catalunya, 08018 Barcelona, Spain

3. ISI Foundation, 10126 Turin, Italy

Abstract

Identifying similar network structures is key to capturing graph isomorphisms and learning representations that exploit structural information encoded in graph data. This work shows that ego networks can produce a structural encoding scheme for arbitrary graphs with greater expressivity than the Weisfeiler–Lehman (1-WL) test. We introduce IGEL, a preprocessing step to produce features that augment node representations by encoding ego networks into sparse vectors that enrich message passing (MP) graph neural networks (GNNs) beyond 1-WL expressivity. We formally describe the relation between IGEL and 1-WL, and characterize its expressive power and limitations. Experiments show that IGEL matches the empirical expressivity of state-of-the-art methods on isomorphism detection while improving performance on nine GNN architectures and six graph machine learning tasks.

Publisher

MDPI AG

Subject

Artificial Intelligence,Engineering (miscellaneous)

Reference62 articles.

1. Bronstein, M.M., Bruna, J., Cohen, T., and Veličković, P. (2021). Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges. arXiv.

2. Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W.L., and Leskovec, J. (2018, January 19–23). Graph convolutional neural networks for web-scale recommender systems. Proceedings of the 24th ACM International Conference on Knowledge Discovery & Data Mining, London, UK.

3. Duvenaud, D.K., Maclaurin, D., Iparraguirre, J., Bombarell, R., Hirzel, T., Aspuru-Guzik, A., and Adams, R.P. (2015, January 7–12). Convolutional Networks on Graphs for Learning Molecular Fingerprints. Proceedings of the Advances in Neural Information Processing Systems, Montreal, Canada.

4. Neural Message Passing for Quantum Chemistry;Gilmer;Proceedings of the 34th International Conference on Machine Learning,2017

5. NEVAE: A Deep Generative Model for Molecular Graphs;Samanta;J. Mach. Learn. Res.,2020

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3