How Embeddings Shape Graph Neural Networks: Classical vs Quantum-Oriented Node Representations

Nouhaila Innan 1,2 , Antonello Rosato 3 , Alberto Marchisio 1,2 , and Muhammad Shafique 1,2 · 2026

Read How Embeddings Shape Graph Neural Networks: Classical vs Quantum-Oriented Node Representations by Nouhaila Innan 1,2 , Antonello Rosato 3 , Alberto Marchisio 1,2 , and Muhammad Shafique 1,2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15273.txt.

Introduction

Innan and three colleagues run a fair head-to-head test of how node embeddings, the numeric summaries fed to graph neural networks, affect graph classification. Classical methods and quantum-oriented variants share one backbone, splits, and training budget across five TU sets and a converted QM9 set. Quantum-oriented embeddings win most steadily on structure-led sets, while plain social graphs still suit classical methods.

Catalog record

CREATORNouhaila Innan 1,2 , Antonello Rosato 3 , Alberto Marchisio 1,2 , and Muhammad Shafique 1,2
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32133
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.15273

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

How Embeddings Shape Graph Neural Networks: Classical vs Quantum-Oriented Node Representations Nouhaila Innan 1,2 , Antonello Rosato 3 , Alberto Marchisio 1,2 , and Muhammad Shafique 1,2 Abstract Node embeddings act as the information interface for graph neural networks, yet their empirical impact is often reported under mismatched backbones, splits, and training budgets. This paper provides a controlled benchmark of embedding choices for graph classification, comparing classical baselines with quantum-oriented node representations under a unified pipeline. We evaluate two classical baselines alongside quantum-oriented alternatives, including a circuit-defined variational embedding and quantum-inspired embeddings computed via graph operators and linear-algebraic constructions. All variants are trained and tested with the same backbone, stratified splits, identical optimization and early stopping, and consistent metrics. Experiments on five different TU datasets and on QM9 converted to classification via target binning show clear dataset dependence: quantum-oriented embeddings yield the most consistent gains on structure-driven benchmarks, while social graphs with limited node attributes remain well served by classical baselines. The study highlights practical trade-offs between inductive bias, trainability, and stability under a fixed training budget, and offers a reproducible reference point for selecting quantum-oriented embeddings in graph learning. I Introduction Graph-level prediction depends strongly on how node information is represented before and during message passing. Although node embeddings can substantially affect the information available to the graph classifier, their contribution is often difficult to assess in isolation because prior comparisons are frequently confounded by differences in backbone architectures, data splits, optimization settings, and training budgets. This work studies, under a unified protocol, how different embedding modules influence downstream graph-level prediction when the GNN backbone is kept fixed. Specifically, we integrate a family of quantum-inspired embedding constructions into the same GNN pipeline and evaluate them on a shared set of graph classification benchmarks, including a molecular benchmark. Performance is measured using test Accuracy, Macro-F1, and Macro Precision/Recall. Rather than claiming that one embedding family is universally superior, the aim is to isolate the effect of the embedding stage and identify when different inductive biases are beneficial. Across all experiments, each node is described using lightweight structural and positional information. Let x denote the base node feature vector, constructed from one-hot degree encodings, and let pe denote the Laplacian positional encoding (LPE) vector computed from the eigenvectors of the normalized graph Laplacian [ 5 ] . The notation (x\|pe) denotes the concatenation of these two vectors. Some methods operate directly on this representation, while others generate additional features through graph-dependent dynamics and fuse them with the same base input. The embedding variants considered in this paper cover a range of design principles. As classical controls, we include a Fixed embedding obtained through a fixed random projection of (x\|pe) and a trainable multi-layer perceptron ( MLP ) applied to (x\|pe) . As a trainable quantum-circuit baseline, we include a variational quantum circuit ( VQC ) with angle encoding, denoted as Angle-VQC , where node features are encoded as circuit angles and measurement outcomes define node embeddings [ 3 , 6 ] . We then consider three quantum-inspired constructions defined through graph dynamics: • QuOp , which derives embeddings from local operator evolution on ego-neighborhood subgraphs, • QWalkVec , which constructs node vectors from coined quantum-walk-style evolution over a fixed number of steps, • QPE , which produces node descriptors from transition probabilities derived from a matrix-exponential formulation with anchor-node conditioning. For both QuOp and QWalkVec, we evaluate non-trainable and trainable versions. In the results, the trainable variants are marked with a superscript ∗ , indicating that a learnable fusion or projection stage is enabled. These methods were selected to represent different ways of constructing node embeddings, including projection-based baselines, circuit-defined quantum embeddings, operator-based encodings, walk-based encodings, and spectral or positional constructions. Comparing them within one shared pipeline allows us to examine whether these different inductive biases lead to different graph-classification behavior under matched training conditions. The central question of this study is: given the same GNN backbone and training protocol, when does injecting operator- or walk-based structure into the embedding stage improve graph-level prediction relative to standard projection-based or MLP-based alternatives? To answer this, we vary only the embedding module while keeping the downstream architecture and training setup unchanged. We also compare trainable and non-trainable variants to distinguish gains arising from additional learnable capacity from those due to the embedding construction itself. Our working hypothesis is that embeddings encoding higher-order structure, walk dynamics, or positional information may be more effective when graph labels depend on multi-hop structural patterns, whereas simpler baselines may remain competitive when local descriptors are already sufficient. The main contribution of this paper is a unified experimental framework for evaluating the role of the node embedding stage under a fixed GNN backbone and shared protocol. By reporting multiple metrics and, where applicable, both trainable and non-trainable configurations, the study clarifies when performance differences are attributable to the embedding design itself and when they are associated with additional trainable components. Because all methods are evaluated under the same finite optimization budget, the benchmark should be interpreted as a comparison under equal training resources rather than as an estimate of the maximum achievable performance of each method after exhaustive tuning. The remainder of the paper presents the embedding constructions and their integration into the shared model, followed by an empirical analysis on TU [ 9 ] and QM9 [ 10 ] datasets, and a discussion of the methodological insights suggested by the observed performance patterns. II Background and Related Work II-A Node representations for graph classification Graph neural networks (GNNs) rely on node-level inputs that determine what information can be propagated and pooled at the graph level [ 7 ] . In practical benchmarks, node attributes may be rich (molecular graphs) or entirely absent (social-network TU datasets such as IMDB variants). Graph benchmarking is a specific challenging problem [ 4 ] , and when attributes are missing, a common strategy is to construct simple structural features (e.g., node degree) to provide a consistent input interface, while keeping the injected signal minimal [ 13 ] . In this work, we focus on how different node-embedding mechanisms, including quantum-oriented representations, affect downstream graph classification when the backbone and training protocol are held fixed. II-B Quantum-oriented node embeddings Quantum-oriented embeddings fall into two broad families. The first family is circuit-defined embeddings , where a parameterized quantum circuit maps node features to a fixed-dimensional representation (e.g., Angle-VQC). The second family is quantum-inspired embeddings , which borrow primitives from quantum dynamics or quantum information (operators, walks, phase encodings) but are computed via graph operators and linear algebra [ 1 ] . Our benchmark includes three representative quantum-inspired methods from recent literature: QuOp [ 14 ] , QWalkVec [ 11 ] , and QPE [ 12 ] . While these approaches are motivated by quantum formalisms, in our implementation, they are evaluated under the same classical training pipeline and compared against classical baselines. II-B 1 QuOp: quantum operator node representations QuOp [ 14 ] constructs a node representation from local operator dynamics on an ego neighborhood. For each node, a neighborhood-induced operator is mapped to a unitary transformation, and summary statistics of the resulting state are used as the embedding. This yields a representation that explicitly

Read the complete text