GOTHAM: Graph Class Incremental Learning Framework under Weak Supervision

Aditya Hemant Shahane [email protected], Prathosh A. P. [email protected], Sandeep Kumar [email protected] · 2025

Read GOTHAM: Graph Class Incremental Learning Framework under Weak Supervision by Aditya Hemant Shahane [email protected], Prathosh A. P. [email protected], Sandeep Kumar [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-04954.txt.

Introduction

Graphs in commerce and medicine keep gaining new categories, while labels for the new ones are scarce or absent. Aditya Shahane, Prathosh, and Sandeep Kumar tackle that growth in this 2025 paper. Their framework, GOTHAM, learns node categories as they arrive in streams. Training leans on meta-learning over base classes with few labels each.

New classes may bring a handful of labels, or none at all. Standard methods assume rich labels for every class, which practice rarely supplies. Weak supervision is the paper's core condition. Node classification on evolving graphs feeds recommendations, care decisions, and social platforms. A method that absorbs novelty cheaply keeps those systems current.

Catalog record

CREATORAditya Hemant Shahane [email protected], Prathosh A. P. [email protected], Sandeep Kumar [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-04954

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GOTHAM: Graph Class Incremental Learning Framework under Weak Supervision Aditya Hemant Shahane [email protected], Prathosh A. P. [email protected], Sandeep Kumar [email protected] Abstract Graphs are growing rapidly, along with the number of distinct label categories associated with them. Applications like e-commerce, healthcare, recommendation systems, and various social media platforms are rapidly moving towards graph representation of data due to their ability to capture both structural and attribute information. One crucial task in graph analysis is node classification, where unlabeled nodes are categorized into predefined classes. In practice, novel classes appear incrementally sometimes with just a few labels (seen classes) or even without any labels (unseen classes), either because they are new or haven’t been explored much. Traditional methods assume abundant labeled data for training, which isn’t always feasible. We investigate a broader objective: Graph Class Incremental Learning under Weak Supervision (GCL) , addressing this challenge by meta-training on base classes with limited labeled instances. During the incremental streams, novel classes can have few-shot or zero-shot representation. Our proposed framework GOTHAM efficiently accommodates these unlabeled nodes by finding the closest prototype representation, serving as class representatives in the attribute space. For Text-Attributed Graphs (TAGs), our framework additionally incorporates semantic information to enhance the representation. By employing teacher-student knowledge distillation to mitigate forgetting, GOTHAM achieves promising results across various tasks. Experiments on datasets such as Cora-ML, Amazon, and OBGN-Arxiv showcase the effectiveness of our approach in handling evolving graph data under limited supervision. The repository is available here: Code Reviewed on OpenReview: https://openreview.net/forum?id=hCyT4RsF27¬eId=eAOjhejWbB 1 Introduction Graph-structured data are ubiquitously used in many real-world applications, such as citation graphs ( Cummings & Nassar, 2020 ; Tang et al., 2008 ) , biomedical graphs ( Subramanian et al., 2005 ; Zhai et al., 2023 ) , circuit optimization ( Shahane et al., 2023 ; Hakhamaneshi et al., 2023 ) and social networks ( Qi et al., 2012 ) . Recently, Graph Neural Networks (GNNs) have been proposed ( Cao et al., 2016 ; Subramanian et al., 2005 ; Henaff et al., 2015 ; Xu et al., 2019 ; Kipf & Welling, 2017 ; Veličković et al., 2018 ; Hamilton et al., 2017 ) to model graph-structured data by leveraging the structural and attributed information along the graph. As a central task in graph machine learning, node classification ( Wang et al., 2020b ; Xhonneux et al., 2020 ; Wang et al., 2021b ; Zhu et al., 2021 ) has achieved remarkable progress with the rise of GNNs. While these methods concentrate on static graphs to classify unlabeled nodes into predetermined classes, real-world graphs are dynamic. In practice, graphs grow ( You et al., 2022 ; Lu et al., 2022 ; Tan et al., 2022 ) rapidly incorporating nodes and edges belonging to novel classes incrementally. For example, (1) think of a biomedical graph. Each node represents a rare disease category, and edges show how these diseases relate to each other. As new disease categories emerge, they are gradually added to this graph. Such methods significantly aid the drug discovery process. (2) For food delivery systems nodes correspond to various zip codes and the edges indicate the spatial distances between them. As the company expands its reach, new zip codes are systematically incorporated into this graph, facilitating efficient supply chain management. GNNs typically require a large amount of labeled data to learn effective node representations ( Ding et al., 2020b ; Zhou et al., 2019b ) . In practice, catching up with these newly emerging classes is tough, and obtaining extensive labeled data for each class is even harder. The annotation process can be extremely time-consuming and expensive ( Ding et al., 2022 ; Guo et al., 2021 ; Wang et al., 2022c ) . Naturally, it becomes crucial to empower models to classify the nodes from: limited labeled classes and those unseen classes having no labeled instances, collectively referred to as weakly supervised. In this regard, we investigate the problem of Graph Class Incremental Learning under Weak Supervision (GCL) . Recent studies ( Lu et al., 2022 ; Tan et al., 2022 ) , have delved into a specific aspect of the broader problem, termed graph few-shot class incremental learning (GFSCIL). This approach operates under the assumption that the base classes possess abundant labeled instances, while novel classes introduced during streaming sessions always have representations in the form of k -shots. Additionally, there is a separate line of research ( Wang et al., 2021b ; Wang et al., 2023b ; Hanouti & Borgne, 2022 ) , focusing on zero-shot node classification. Furthermore, addressing the issue of limited labeled data availability during base training, which impacts the model’s generalizability for better node representations during finetuning, is discussed in Wang et al. () . Finally, studies like ( Wang et al., 2023a ; Wang et al., ) address few-shot node classification. Graph data, existing in a non-Euclidean space with constantly changing network structures, poses unique challenges. Unlike the progress made in class incremental learning in computer vision, incremental learning in graphs remains relatively unexplored. Therefore, for developing a framework for GCL the key challenges include: (1) Can the model learn good node representations with just k -shots for base training classes during finetuning? (2) Is there a universal framework to address both the GFSCIL problem (classes in novel streams represented by k -shots) and the GCL task (including classes with no training instances)? and finally, (3) How to prevent forgetting old knowledge while learning new information? Sometimes, Less is Plenty . By heuristically sampling the neighborhood corresponding to the k -shot representations, our approach extends the support set for each class. These prototypes serve a crucial role in steering the orientation of both base and novel classes within the graph during streaming sessions. We adopt the popular meta-learning strategy, called episodic learning ( Finn et al., 2017 ) , which has shown great promise in few-shot learning. We propose Graph Orientation Through Heuristics And Meta-learning (GOTHAM) , an incremental learning framework that effectively addresses all the aforementioned issues. Finally, the teacher-student knowledge distillation in GOTHAM prevents catastrophic forgetting. The paper is structured into seven sections, focusing on class orientation through prototypes, proposed approach, experimental analysis, and concluding remarks. 2 Related Work Continual Graph Learning : The Continual Graph Learning Benchmark (CGLB) ( ZHANG et al., 2022 ) categorizes tasks in evolving graph structures into Continual Graph Learning (CGL) ( Wang et al., 2022a ; Xu et al., 2020 ; Daruna et al., 2021 ; Ahrabian et al., 2021 ; Kou et al., 2020 ) , Dynamic Graph Learning (DGL) ( Galke et al., 2020 ; Wang et al., 2020a ; Yu et al., 2018 ; Han et al., 2020 ) , and Few-Shot Graph Learning (FSGL) ( Zhou et al., 2019a ; Guo et al., 2021 ; Yao et al., 2020 ) . CGL focuses on mitigating catastrophic forgetting without relying on past data, DGL captures temporal dynamics with access to historical data, and FSGL enables rapid adaptation to new tasks using meta-learning. Our work lies at the intersection of CGL and FSGL. We review related work on few-shot, zero-shot, and incremental learning for graph-based tasks, positioning our contributions within this broader framework. Few-Shot Node Classification : Despite

Read the complete text