Text-attributed Graph Condensation via Text Selection and Attribute Matching Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates. Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates ISBN: 979-8-4007-2307-0/2026/04 DOI: 10.1145/3774904.3792205 CCS: Information systems Data mining
Haowei Han, Yuxiang Wang, Guojia Wan, Hao Wang, Shanshan Feng, Hao Huang, Jiawei Jiang, Xiao Yan · 2026
Read Text-attributed Graph Condensation via Text Selection and Attribute Matching Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates. Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates ISBN: 979-8-4007-2307-0/2026/04 DOI: 10.1145/3774904.3792205 CCS: Information systems Data mining by Haowei Han, Yuxiang Wang, Guojia Wan, Hao Wang, Shanshan Feng, Hao Huang, Jiawei Jiang, Xiao Yan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03839.txt.
Introduction
Han and co-authors condense text-attributed graphs while keeping training accuracy high. Such graphs pair each node with a text description. Models train a graph network and a language model jointly, at high cost. Condensation shrinks the graph before training starts. Their method, TAGSAM, compresses both texts and topology.
For texts, a selection step merges representative chunks from related descriptions. It maximizes mutual information while doing so. For topology, matching training trajectories suffers from high variance. Attribute similarity matching steadies it by aligning stable similarity matrices. Six state-of-the-art baselines face TAGSAM in tests. At equal compressed size, accuracy tops the best rival by about five points on average. Even at one percent of the original size, training accuracy stays competitive. Code is public for graph learning teams.
Catalog record
| CREATOR | Haowei Han, Yuxiang Wang, Guojia Wan, Hao Wang, Shanshan Feng, Hao Huang, Jiawei Jiang, Xiao Yan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.03839
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Text-attributed Graph Condensation via Text Selection and Attribute Matching Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates. Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates ISBN: 979-8-4007-2307-0/2026/04 DOI: 10.1145/3774904.3792205 CCS: Information systems Data mining Haowei Han, Yuxiang Wang, Guojia Wan, Hao Wang, Shanshan Feng, Hao Huang, Jiawei Jiang, Xiao Yan Abstract . Text-Attributed Graph (TAG) is an important type of graph structured data, where each node has a text description. TAG models usually train a Graph Neural Network (GNN) and language model jointly, which leads to high space and time consumption, especially on large datasets. To mitigate this, we propose TAGSAM, a condensation method that compresses TAGs while preserving training accuracy. TAGSAM comes with two key designs, i.e., subgraph text Selection and Attribute similarity Matching , which compress the text description and graph topology of TAG, respectively. For the texts, subgraph text selection selects and merges representative text chunks from multiple related text descriptions by maximizing mutual information. For the graph topology, popular condensation methods based on Matching Training Trajectories (MTT) suffer from high variance, which hinders accuracy. Our attribute similarity matching mitigates this issue by aligning stable similarity matrices. We evaluate TAGSAM against six state-of-the-art baselines, where it showcases superior performance. For the same compressed size, TAGSAM improves upon the best-performing baseline by an average of 4.9% in accuracy. Furthermore, it maintains competitive training accuracy even when the TAG is condensed to just 1% size. Our code is available at https://github.com/SundayVHan/TAGSAM † † cc-license: by 1. Introduction Text-Attributed Graphs (TAGs) ( 3 ; 22 ) integrate graph topology with textual node descriptions. Current methods jointly train a Graph Neural Network (GNN) and a language model; for example, G2P2 ( 40 ) aligns graph and text encoder representations via contrastive learning, while GraphCLIP ( 48 ) utilizes an LLM to summarize local neighborhoods for richer context. Applied to tasks like article classification and social network analysis ( 18 ; 1 ; 38 ; 35 ; 12 ) , TAG models leverage text as an extra supervisory signal to lower label dependency and boost zero-shot capabilities compared to traditional graph models. However, this dual-modal training remains highly memory- and time-intensive on large datasets. Dataset condensation ( 34 ; 46 ) reduces training costs by compressing a large dataset into a smaller, highly representative one. Current approaches fall into two categories. Selective methods ( 10 ; 39 ; 7 ; 2 ) curate a representative subset from the original data; for instance, Herding ( 39 ) minimizes the feature discrepancy between the subset and the full dataset. Generative methods ( 34 ; 47 ; 46 ) synthesize compressed data via bi-level optimization, aligning student models (trained on compressed data) with teacher models (trained on original data). This paradigm has recently been extended to graph by methods like GCond ( 14 ) , which matches gradients between student and teacher models to generate synthetic graphs. Figure 1 . Comparison of different dataset condensation paradigms. Unlike existing methods, TAGSAM ensures label independence and preserves the discrete nature of text data. Comparison to traditional graph condensation. While effective for standard graphs, traditional graph condensation methods like GCond is ill-suited for TAGs. As Figure 1 demonstrates, such paradigm face two key limitations in this context: First, they condense only the graph modality, ignoring the rich, high-dimensional text. Second, their reliance on label supervision is incompatible with common TAG scenarios, where ground-truth labels are often scarce or entirely unavailable due to high annotation costs ( 40 ) . Consequently, these traditional methods, not being designed to preserve joint information, fail to meet the needs of TAG models for tasks like contrastive learning and zero-shot classification. Challenges for current condensation methods. Among recent advances, the work most relevant to TAG condensation is the line of multi-modal dataset condensation methods that employ Matching Training Trajectories (MTT) to compress image-text datasets ( 41 ; 43 ) , which involves aligning the model parameter update trajectories produced between training on original dataset and compressed one. Yet, despite their success elsewhere, we find they perform poorly on TAGs due to the following two reasons: \bullet Unreadable text. MTT employs gradient descent for condensation, which excels continuous features but struggles with discrete text, resulting in text being compressed into unreadable embedding vectors. Consequently, these embeddings are incompatible with downstream models like tokenizers. While retrieving nearest neighbor original texts in embedding space as substitutes is attempted, it incurs long runtime and lower model performance. \bullet Unstable training. As shown in Figure 2 (a), MTT exhibits significantly volatile training loss and accuracy when condensing a TAG, consequently resulting in sub-optimal convergence. This instability arises because the teacher model’s contrastive loss, computed on randomly sampled mini-batches, yields high trajectory variance, and hinders the student model’s matching process. Figure 2 . Matching training trajectories vs. Attribute similarity matching. The left and right y-axes denote the model loss and accuracy, respectively. These analysis shows that existing condensation methods cannot work well on TAGs. Thus, we ask the following research question: Is it possible to design a TAG condensation method in no-label scenarios, which can generate discrete compressed text and achieves stable convergence? To answer this question, we propose TAGSAM, which tackles the two critical challenges of MTT through two key components: subgraph text selection and attribute similarity matching . Instead of updating compressed text embeddings via SGD, subgraph text selection directly selects representative text from the original space. Besides, compared to condensing TAGs via matching training trajectories, which suffers from high variance due to random batching, we propose to match attribute similarity, which is inherently more stable. This approach yields greater training stability and improves model accuracy, as shown in Figure 2 (b). Furthermore, we theoretically analyze our proposed method. First, for subgraph text selection, we introduce a practical greedy method and theoretically demonstrate that it effectively approximates the optimal solution. Second, we prove that attribute similarity serves as an effective estimate for point-wise mutual information between attributes, and is thereby inherently stable, leading to more robust training. To evaluate TAGSAM, we conduct extensive experiments and compare it with 6 state-of-the-art dataset condensation methods. The results show that TAGSAM consistently yields higher model training accuracy than all baselines. Compared with the best performing baseline, the average accuracy improvement of TAGSAM is 4.9%. Moreover, TAGSAM achieves competitive training accuracy with only a 1% condensation ratio of original TAGs. Besides, ablation studies indicate our model designs are effective. Furthermore efficiency studies suggest that TAGSAM is efficient in running time. To summarize, we make the following contributions: \bullet We identify that traditional graph condensation methods are unsuitable for TAG condensation scenarios, and existing multi-modal dataset condensation methods perform poorly due to issues such as unreadable text and high variance. \bullet We propose subgraph text selection to select representative texts in the discrete text space, and introduce attribute similarity matching to reinforce robustness via matching stable attribute correlations instead of training trajectories. \bullet We conduct extensive experiments on 5 datasets and compare TAGSAM with 6 state-of-the-art baselines. On average, TAGSAM raises downstream models’ accuracy by 4.9% over the strongest baseline, and matches or even improves the running