Robust Graph Meta-learning for Weakly-supervised Few-shot Node Classification

Author:

Ding Kaize1,Wang Jianling2,Li Jundong3,Caverlee James2,Liu Huan4

Affiliation:

1. Northwestern University, USA

2. Texas A&M University, USA

3. University of Virginia, USA

4. Arizona State University, USA

Abstract

Graph machine learning (Graph ML) models typically require abundant labeled instances to provide sufficient supervision signals, which is commonly infeasible in real-world scenarios since labeled data for newly emerged concepts (e.g., new categorizations of nodes) on graphs is rather limited. In order to efficiently learn with a small amount of data on graphs, meta-learning has been investigated in graph ML. By transferring the knowledge learned from previous experiences to new tasks, graph meta-learning approaches have demonstrated promising performance on few-shot graph learning problems. However, most existing efforts predominately assume that all the data from the seen classes is gold-labeled, while those methods may lose their efficacy when the seen data is weakly-labeled with severe label noise. As such, we aim to investigate a novel problem of weakly-supervised graph meta-learning for improving the model robustness in terms of knowledge transfer. To achieve this goal, we propose a new graph meta-learning framework – Graph Interpolation Networks (Meta-GIN). Based on a new robustness-enhanced episodic training paradigm, Meta-GIN is meta-learned to interpolate node representations from weakly-labeled data and extracts highly transferable meta-knowledge, which enables the model to quickly adapt to unseen tasks with few labeled instances. Extensive experiments demonstrate the superiority of Meta-GIN over existing graph meta-learning studies on the task of weakly-supervised few-shot node classification.

Publisher

Association for Computing Machinery (ACM)

Subject

General Computer Science

Reference55 articles.

1. Jinheon Baek , Dong Bok Lee , and Sung Ju Hwang . 2020. Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction. NeurIPS ( 2020 ). Jinheon Baek, Dong Bok Lee, and Sung Ju Hwang. 2020. Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction. NeurIPS (2020).

2. Jatin Chauhan Deepak Nathani and Manohar Kaul. 2019. FEW-SHOT LEARNING ON GRAPHS VIA SUPER-CLASSES BASED ON GRAPH SPECTRAL MEASURES. In ICLR. Jatin Chauhan Deepak Nathani and Manohar Kaul. 2019. FEW-SHOT LEARNING ON GRAPHS VIA SUPER-CLASSES BASED ON GRAPH SPECTRAL MEASURES. In ICLR.

3. Pengfei Chen Ben Ben Liao Guangyong Chen and Shengyu Zhang. 2019. Understanding and utilizing deep neural networks trained with noisy labels. In ICML. Pengfei Chen Ben Ben Liao Guangyong Chen and Shengyu Zhang. 2019. Understanding and utilizing deep neural networks trained with noisy labels. In ICML.

4. Kaize Ding Jundong Li Rohit Bhanushali and Huan Liu. 2019. Deep anomaly detection on attributed networks. In SDM. Kaize Ding Jundong Li Rohit Bhanushali and Huan Liu. 2019. Deep anomaly detection on attributed networks. In SDM.

5. Kaize Ding Jianling Wang Jundong Li Kai Shu Chenghao Liu and Huan Liu. 2020. Graph prototypical networks for few-shot learning on attributed networks. In CIKM. Kaize Ding Jianling Wang Jundong Li Kai Shu Chenghao Liu and Huan Liu. 2020. Graph prototypical networks for few-shot learning on attributed networks. In CIKM.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3