TGraphX: Tensor-Aware Graph Neural Network for Multi-Dimensional Feature Learning
Arash Sajjadi *, Mark Eramian * · 2025
Read TGraphX: Tensor-Aware Graph Neural Network for Multi-Dimensional Feature Learning by Arash Sajjadi *, Mark Eramian * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03953.txt.
Introduction
Arash Sajjadi and Mark Eramian present TGraphX, a deep learning architecture that unifies convolutional and graph neural networks for visual reasoning. Convolutional networks extract rich spatial features from images but cannot model relationships between objects. Graph networks model relationships, yet they usually flatten node features and throw away spatial detail.
TGraphX uses convolutional networks to produce multi-dimensional node features that keep local spatial structure. Message passing between nodes runs through one-by-one convolutions, which fuse neighboring features without collapsing them. A deep convolutional aggregator with residual connections then refines the fused messages, keeping gradient flow stable and training end to end. The authors report significant improvements in object detection refinement and ensemble reasoning. The design suits vision tasks where both fine spatial detail and object relationships matter.
Catalog record
| CREATOR | Arash Sajjadi *, Mark Eramian * |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-03953
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TGraphX: Tensor-Aware Graph Neural Network for Multi-Dimensional Feature Learning Arash Sajjadi *, Mark Eramian * Abstract TGraphX presents a novel paradigm in deep learning by unifying convolutional neural networks (CNNs) with graph neural networks (GNNs) to enhance visual reasoning tasks. Traditional CNNs excel at extracting rich spatial features from images but lack the inherent capability to model inter-object relationships. Conversely, conventional GNNs typically rely on flattened node features, thereby discarding vital spatial details. TGraphX overcomes these limitations by employing CNNs to generate multi-dimensional node features (e.g., 3 × 128 × 128 3\times 128\times 128 tensors) that preserve local spatial semantics. These spatially aware nodes participate in a graph where message passing is performed using 1 × \times 1 convolutions, which fuse adjacent features while maintaining their structure. Furthermore, a deep CNN aggregator with residual connections is used to robustly refine the fused messages, ensuring stable gradient flow and end-to-end trainability. Our approach not only bridges the gap between spatial feature extraction and relational reasoning but also demonstrates significant improvements in object detection refinement and ensemble reasoning. Keywords: Computer Vision, Image Representation, Graph Neural Networks, Convolutional Neural Networks, Spatial Feature Learning, Multi-Dimensional Node Embedding, Convolutional Message Passing, Visual Graph Reasoning, Deep Feature Aggregation, End-to-End Learning, Object Detection. 1 Introduction Visual reasoning tasks such as object detection, scene understanding, and ensemble learning require models to capture both local spatial details and global contextual relationships. Conventional CNNs have been the workhorse for extracting localized features, yet their inherent design limits the ability to reason about relationships between disparate regions. On the other hand, existing GNN approaches [ 1 , 4 ] excel in modeling interactions between objects but usually employ vectorized node representations that inherently lose spatial structure. 1.1 Motivation The key limitation in current approaches lies in their treatment of visual data: • CNN Limitations: Although CNNs efficiently extract features from local regions, they lack explicit mechanisms to capture inter-region dependencies or long-range interactions. • GNN Limitations: Standard GNNs operate on flat node features (i.e., 1D vectors) and apply simplistic message passing (e.g., via multi-layer perceptrons or dot products) that ignore the inherent two-dimensional spatial context of image patches. These issues motivate the development of TGraphX, where spatial feature maps produced by CNNs are directly used as graph nodes. This design maintains local spatial information during graph construction and message passing. 1.2 Proposed Approach In TGraphX, an input image is first divided into patches. Each patch is then processed by a CNN encoder, generating a spatial feature map X_{i}\in\mathbb{R}^{C\times H\times W}. These feature maps serve as nodes in a graph \mathcal{G}=(\mathcal{V},\mathcal{E}) , where edges are defined by spatial or semantic proximity. Unlike traditional GNNs, the message passing mechanism in TGraphX operates on the full tensor representation. For instance, the message from node i to node j is computed as: M_{ij}=\text{Conv}_{1\times 1}\Bigl(\text{Concat}(X_{i},X_{j},E_{ij})\Bigr), (1) where E_{ij} represents optional edge features that can be concatenated if available. This operation allows the network to fuse spatial details between adjacent regions without flattening the data. Following message computation, the aggregated messages at node j are processed by a deep CNN aggregator with residual connections: X_{j}^{\prime}=X_{j}+\mathcal{A}\Bigl(\sum_{i\in\mathcal{N}(j)}M_{ij}\Bigr). (2) This residual design not only preserves the original node features but also ensures that gradients flow effectively during training. 1.3 Key Contributions The main technical contributions of TGraphX can be summarized as: • CNN-Powered Node Features: Introducing multi-dimensional tensor representations as graph nodes, thus preserving the spatial layout crucial for visual tasks. • Convolution-Based Message Passing: Utilizing 1 \times 1 convolutional layers for message computation that respect the spatial dimensions of the node features, with an optional inclusion of edge features E_{ij} . • Deep CNN Aggregation with Residuals: Employing a deep convolutional aggregator to refine messages, with residual skip connections that promote stable learning and mitigate vanishing gradients. • End-to-End Differentiability: Formulating an architecture where all components—from CNN feature extraction to GNN message passing and aggregation—are fully differentiable, enabling seamless end-to-end training. 1.4 Overview and Organization To guide the reader through the structure of this work, we outline the organization of the paper as follows. Section 2 reviews related work and discusses the strengths and limitations of existing approaches. In Section 3 , we introduce the TGraphX model architecture. Section 4 presents experimental results and evaluations. Section 5 outlines the key novel contributions of our work. Section 6 concludes the paper and offers directions for future research. A detailed list of symbols and notations used throughout the paper is provided in the Appendix. 2 Related Work Graph neural networks (GNNs) have evolved from early spectral methods to sophisticated architectures that integrate deep learning with graph modeling. The seminal work on Graph Convolutional Networks (GCNs) [ 3 ] and Graph Attention Networks (GATs) [ 10 ] laid the groundwork by representing nodes as 1D feature vectors aggregated through simple, permutation-invariant functions. Although these methods achieved notable success in semi-supervised classification and social network analysis, their reliance on flattened representations leads to a loss of spatial hierarchies—information that is critical for visual reasoning. Traditional GNN approaches tend to discard the rich spatial structure inherent in image data when visual features are vectorized. This results in the loss of subtle local patterns and contextual relationships that are vital for tasks such as object detection and scene understanding. Furthermore, fixed aggregation functions (e.g., mean or max pooling) and static graph structures limit the capacity to model complex interactions among different image regions. Similarly, SIA-GCN [ 4 ] utilizes 2D spatial feature maps (heatmaps) for hand pose estimation and applies per-edge convolutions to capture distinct spatial relationships between joints. While this design preserves fine-grained spatial details, it is limited by its domain-specific graph structure (the fixed hand-skeleton topology) and the computational overhead of high-resolution feature maps. Vision GNN [ 1 ] splits an image into patches and converts these into flattened vectors for a k-nearest neighbor graph, but this process sacrifices intra-patch spatial detail. Vision HGNN [ 2 ] further extends this idea by employing hypergraphs to connect groups of patches and capture higher-order interactions; however, this comes at the cost of increased architectural complexity. Other recent methods have explored efficiency and adaptability. WiGNet [ 9 ] partitions images into local windows and builds separate graphs for each window, interleaving with shifted windows to enable cross-window communication. Although this approach reduces computational complexity, its fixed window-based structure may limit global context integration. Spatial-Aware Graph Relation Networks [ 11 ] incorporate spatial priors using learnable Gaussian kernels to modulate the influence of neighboring nodes based on relative positions, which has proven effective for object detection but is less general for other vision tasks. More recent developments such as MobileViG [ 6 ] and GreedyViG [ 7 ] introduce lightweight, sparse graph architectures with fixed axial or dynamically selected connectivity, respectively, to reduce computational costs while preserving essential spatial interactions. TGraphX distinguishes itself by maintaining full spatial feature maps throughout the network and enabling adaptive, deep graph aggregation. By directly integrating CNN-based feature extraction with flexible GNN layers, TGraphX is capable of modeling both fine-grained local details and global context in a unified, end-to-end framework. The following table summarizes key architectural attributes of these methods along with their publication years: See Figure 1 for an overview in