Graph Transductive Sharpening: Leveraging Unlabeled Predictions in Node Classification
Brown Zaz, Mar Gonzàlez I Català, Ferran Hernandez Caralt, Moshe Eliasof, Pietro Liò · 2026
Read Graph Transductive Sharpening: Leveraging Unlabeled Predictions in Node Classification by Brown Zaz, Mar Gonzàlez I Català, Ferran Hernandez Caralt, Moshe Eliasof, Pietro Liò (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20248.txt.
Introduction
Brown Zaz and four co-workers revisit the objective for node classification in the transductive setting, where the graph is seen but labels cover only some nodes. Transductive models predict nodes, but standard objectives discard unlabeled predictions for lack of ground truth. Splitting cross-entropy into label alignment and entropy terms, they propose prediction confidence as a way to extract signal without labels. Transductive Sharpening: a loss change minimizing prediction entropy on unlabeled nodes while counterbalancing labeled ones. Tests across benchmarks show steady gains with no backbone changes.
Catalog record
| CREATOR | Brown Zaz, Mar Gonzàlez I Català, Ferran Hernandez Caralt, Moshe Eliasof, Pietro Liò |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53362 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20248
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Graph Transductive Sharpening: Leveraging Unlabeled Predictions in Node Classification Brown Zaz, Mar Gonzàlez I Català, Ferran Hernandez Caralt, Moshe Eliasof, Pietro Liò Abstract In the transductive setting, where the full graph is observed but node labels are only partially available, progress in semi-supervised node classification has largely focused on architectural innovation. In this paper, we revisit an orthogonal axis: the training objective. We start from a simple observation: transductive models produce predictions for every node during training, including nodes without labels. These unlabeled-node predictions may contain useful training signal, but standard supervised objectives discard them because no ground-truth labels are available. Inspired by the decomposition of cross-entropy into a label-dependent alignment term and a label-independent entropy term, we propose prediction confidence as a natural way to extract this signal in the absence of labels. This motivates Transductive Sharpening (TS): a loss-level modification that minimizes prediction entropy on unlabeled nodes while counterbalancing this effect on labeled nodes. We evaluate Transductive Sharpening across a wide range of node-classification benchmarks and observe consistent performance improvements without requiring any changes to the backbone architecture. Code is available at https://github.com/transductive-sharpening/tunedGNN . 1 Introduction Graph neural networks (GNNs) 13 ; 14 ; 4 ; 7 ; 21 ; 42 ; 17 ; 12 have become the dominant approach for node classification tasks, particularly in the transductive setting 3 , where the full graph is observed but only a subset of node labels is available. Over the past years, progress in this area has been driven largely by architectural innovation, with increasingly sophisticated message-passing schemes 16 ; 57 ; 1 ; 31 ; 24 and transformer-based models 19 . In contrast, the design of training objectives has received comparatively little attention, despite its central role in shaping model performance. In the transductive setting, models produce predictions for all nodes in the graph at every training step, including those without labels, yet the training objective is applied only to labeled nodes, as standard supervised losses require ground-truth labels. However, once a model begins to form reliable and confident predictions, these may themselves provide a useful learning signal for nodes with unknown labels. We build on this observation by leveraging such predictions, encouraging confidence on unlabeled nodes while preventing overconfidence on labeled ones. We introduce Transductive Sharpening (TS), a simple and elegant loss-level modification that implements this idea. The method introduces a single hyperparameter and can be applied on top of any GNN architecture. Empirically, we show that it consistently improves performance across a wide range of models and benchmarks. To understand the behavior induced by TS, we study the effect of the sharpening coefficient \lambda and analyze how the objective changes the distribution of predictive confidence across the graph. Empirically, we find that moderate positive values of \lambda yield the most reliable gains, and that TS reallocates confidence toward unlabeled nodes as intended by the objective. Our results point to a simple but powerful principle: predictions generated during training, typically discarded when labels are unavailable, can be directly leveraged to improve learning. While we study this idea in the context of transductive graph learning, it naturally extends to other settings, suggesting a general avenue for improving learning algorithms without increasing model complexity. Contributions. Our main contributions are as follows: • We introduce Transductive Sharpening (TS), a simple architecture-agnostic loss modification that turns predictions on unlabeled nodes into a direct training signal for transductive node classification. • We show that TS provides a strong performance-complexity trade-off: it improves standard GNN and MLP baselines across 13 node-classification benchmarks while adding only a single scalar hyperparameter and requiring no architectural changes. • We study the role of the sharpening coefficient \lambda , showing that TS remains effective across a range of positive values, and that a single conservative setting preserves much of the benefit across models and datasets. 2 Background and Setup In this section we provide background material related to our work. Notation. We denote by \Delta^{C-1}=\{p\in\mathbb{R}^{C}_{\geq 0}:\sum_{i=1}^{C}p_{i}=1\} the probability simplex over C classes. Throughout, labels are represented as one-hot vectors y_{v}\in\{0,1\}^{C} , where y_{v,i} indicates whether node v belongs to class i . Node classification tasks consist of assigning a label to each node in a graph based on its features and the graph structure 21 . In the transductive setting, the full graph and node features are available during training, but labels are observed only for a subset of nodes, and the goal is to predict the rest. Definition 1 (Transductive node classification) . Let G=(V,E) be a graph with node features X\in\mathbb{R}^{|V|\times d} . Each node v\in V has an associated label y_{v}\in\{0,1\}^{C} , observed only for a subset V_{L}\subset V (referred to as labeled nodes ). We denote by V_{U}:=V\setminus V_{L} the remaining nodes (referred to as unlabeled nodes ). The objective is to learn a model that predicts labels for nodes in V_{U} , using the full graph G , all node features X , and the labels observed on V_{L} . From standard to augmented training objectives. A common approach to transductive node classification is to train a model in a supervised manner on the labeled subset of nodes, and then use it to generate predictions for the unlabeled nodes. In practice, a model produces, for each node v\in V , a logit vector z_{v}\in\mathbb{R}^{C} and a corresponding probability distribution p_{v}=\mathrm{softmax}(z_{v})\in\Delta^{C-1} . Models are trained using cross-entropy loss applied only to labeled nodes: \mathcal{L}_{\mathrm{sup}}=-\sum_{v\in V_{L}}\sum_{i=1}^{C}y_{v,i}\log p_{v,i}. (1) This objective aligns the model’s predictions with ground-truth labels, but ignores the feature-based outputs generated on unlabeled nodes V_{U} , even though these are computed at every training step as the model processes the full graph. Although the loss cannot be evaluated on unlabeled nodes due to the absence of labels, the model’s predictions produced during training may still contain useful information that could be exploited. This suggests augmenting the objective with an additional term defined over unlabeled nodes similarly to 15 . Definition 2 (Augmented transductive objective) . Consider a transductive node classification problem with labeled nodes V_{L} and unlabeled nodes V_{U} . Let p_{v}\in\Delta^{C-1} denote the predictive distribution for node v . An augmented transductive objective is any training objective of the form \mathcal{L}=\mathcal{L}_{\mathrm{sup}}+f\bigl(\{p_{v}\}_{v\in V_{U}}\bigr), (2) where f:(\Delta^{C-1})^{|V_{U}|}\to\mathbb{R} extracts a learning signal from the model’s predictions on the unlabeled nodes V_{U} . Definition 2 highlights the flexibility of this framework: different choices of f induce different ways of extracting learning signals from unlabeled predictions. For instance, in a binary classification problem with a known balanced class distribution, f could penalize deviations from a balanced prediction distribution over the unlabeled nodes during training. While useful, this example depends on information that may not be available in general. The central question, then, is whether we can choose f in a principled, task-agnostic way that applies broadly across transductive node classification problems. Uncertainty-based learning signals. A natural starting point for designing f is to examine the structure of the supervised loss itself. In particular, cross-entropy admits the following decomposition: Lemma 1 (Cross-entropy decomposition) . For any target distribution y and prediction p , cross-entropy loss can be written as \mathcal{L}_{\mathrm{CE}}(y,p)=H(p)+\sum_{i=1}^{C}(p_{i}-y_{i})\log p_{i}, (3) where H(p)=-\sum_{i}p_{i}\log p_{i} denotes the Shannon entropy 36 . The proof of Lemma 1 is provided