Relations Are Channels: Knowledge Graph Embedding via Kraus Decompositions

Sayan K Chaki · 2026

Read Relations Are Channels: Knowledge Graph Embedding via Kraus Decompositions by Sayan K Chaki (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10317.txt.

Introduction

Sayan K Chaki gives knowledge graph embedding a firm base drawn from quantum theory. Knowledge graphs store facts as triples, such as head entity, relation, and tail entity. Embedding models learn continuous vectors for entities and relations. Past operator models treat each relation as an operator, but never asked what form such an operator must take. His 2026 paper answers that question.

Chaki names three axioms any sound relation operator must meet: linearity, trace preservation, and complete positivity. By the Kraus representation theorem, those axioms define a Kraus channel form, and most past operator models emerge as rank-one special cases. Extending to varied metric geometries via w-Kraus channels, he proposes KrausKGE. It handles one-to-many and many-to-many relations, supports multi-hop reasoning with no path encoders, and needs no norm limits. It beat strong baselines on many-to-many relations.

Catalog record

CREATORSayan K Chaki
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE107 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10317

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Relations Are Channels: Knowledge Graph Embedding via Kraus Decompositions Sayan K Chaki Abstract Knowledge graph embedding (KGE) models typically represent each relation as an operator on entity embeddings. In this work, we identify three structural axioms that any principled relation operator must satisfy, linearity, trace preservation, and complete positivity, and show that they characterize a Kraus channel structure via the Kraus representation theorem. The completeness constraint defining this family is equivalent to these axioms, providing a principled foundation rather than an externally imposed condition. Under this formulation, most existing operator-based KGE models are recoverable as special cases with Kraus rank κ = 1 \kappa=1 under specific embedding choices. We further generalize this characterization to arbitrary metric geometries by introducing w-Kraus channels, which satisfy completeness by construction within their respective spaces. Building on this theory, we propose KrausKGE , a principled KGE model that naturally handles 1 1 -to- N N and N N -to- N N relations, supports k k -hop reasoning without requiring explicit path encoders, and eliminates the need for norm constraints on entity embeddings. Additionally, our framework yields the first theoretically grounded per-relation complexity measure in the KGE literature, with a provable lower bound in terms of the empirical relation matrix rank. Empirical evaluation demonstrates that KrausKGE consistently outperforms strong baselines on N N -to- N N relations, with performance gains that increase monotonically with relation fan-out, in alignment with theoretical predictions. 1 Introduction Knowledge Graphs (KGs) store factual knowledge as triples of the form ( head entity, relation, tail entity ): for example, ( Beethoven, Genre, Classical ) encodes a factual relation between two entities. Large-scale KGs such as YAGO 29 , Wikidata 34 , and Freebase 4 have found broad application in question answering 27 ; 35 , recommendation 17 ; 38 ; 37 , and information retrieval 6 . However, their large scale and complex relational structure make them difficult to manipulate directly. Knowledge Graph Embedding (KGE) addresses this by learning continuous representations of entities and relations, enabling downstream tasks such as link prediction 24 and entity classification 40 . Existing KGE methods organise into four families, each addressing a genuine limitation of the others while introducing its own. The first encodes each relation as a single explicit operator: a translation in TransE 5 , a rotation in RotatE 30 , or an orthogonal transform in GoldE 18 and OrthogonalE 47 ; these models are efficient but collapse multiple valid tails to a single point, failing on N-to-N relations. The second uses multiple operators per relation for expressiveness, as in NTN 28 and MEIM 32 , but adds operators as an engineering choice with no constraint ensuring they are information-preserving. The third replaces explicit operators with nonlinear neural architectures, as in ConvE 11 and R-GCN 26 , recovering multi-pathway expressiveness at the cost of composability for multi-hop reasoning. The fourth represents entities as probability distributions, as in KG2E 14 and TransG 41 , encoding uncertainty without a principled account of how it propagates through a relation. All four families share the same foundational gap: none asks what mathematical structure a relation operator must have by necessity, nor derives that structure from first principles. Our work addresses these theoretical and technical gaps. By the Kraus representation theorem 16 , a linear map on density matrices is completely positive and trace preserving if and only if it admits a Kraus decomposition. Our contribution is identifying that linearity, trace preservation, and complete positivity are precisely the structural conditions any principled relation operator must satisfy in the KGE setting. Each is natural: a relation operator should be linear on entity representations, it should neither inflate nor deflate the total mass of an entity, and it should behave consistently whether an entity is considered in isolation or as part of a larger correlated structure. Together, these three axioms characterize the Kraus channel family, and the completeness constraint introduced through it is equivalent to their conjunction rather than a soft regulariser added after the fact. We further show that the same axiomatic derivation carries through to different metric geometries defined by a quadratic inner product, yielding w-Kraus channels that satisfy completeness by construction across Euclidean, elliptic, hyperbolic, and product manifold geometries. The geometry is a modelling choice; the axioms are universal. This identification has three immediate structural consequences, all following as corollaries of completeness with no additional design choices. Multi-hop reasoning becomes architecture-free, norm constraints on entity embeddings become unnecessary, and the learned Kraus rank yields the first theoretically grounded per-relation complexity measure in the KGE literature, with a provable lower bound. The summary of our contributions are as follows: • Axiomatic characterisation of relation operators. Three structural axioms on principled relation operators, linearity, trace preservation, and complete positivity. They characterize the Kraus channel structure via the Kraus representation theorem. Most operator-family KGE models are recoverable as special cases with \kappa=1 under specific embedding choices. • KrausKGE. A concrete trainable model with density matrix entity representations and learned Kraus operators satisfying completeness by construction, requiring no external regularisation, norm penalties, or path encoders. • Extension to non-Euclidean spaces. The derivation generalises to any quadratic inner product geometry, yielding w-Kraus channels with completeness by construction across Euclidean, elliptic, hyperbolic, and product manifold spaces. • Per-relation complexity measure. The Kraus rank is the first theoretically grounded to our knowledge per-relation diagnostic in the KGE literature, with provable lower bound. 2 Related work The dominant paradigm represents each relation as a single linear operator. TransE 5 encodes relations as translations but is structurally unable to model N-to-N relations, collapsing multiple valid tails to a single point. TransH 39 and TransR 22 address specific limitations while retaining a single operator and requiring external norm constraints. The bilinear family, comprising RESCAL 23 , DistMult 44 , ComplEx 33 , and TuckER 3 , replaces translation with multiplicative interaction but remains within the single-operator regime, inheriting the same structural bottleneck on high fan-out relations. Rotation-based models RotatE 30 , QuatE 46 , DualE 7 , and HousE 19 achieve strong relational pattern inference through geometric operators but are limited to bijective mappings, making N-to-N relations representable only approximately through centroid collapse. GoldE 18 and OrthogonalE 47 push this family to state-of-the-art through generalised orthogonal parametrisation; KrausKGE strictly generalises both by allowing \kappa>1 , which Corollary 3.9 proves is necessary for relations whose empirical matrix rank exceeds the embedding dimension. Geometric methods MuRP 2 , AttH 9 , GIE 8 , and UltraE 42 enrich the representation space but leave the single-operator bottleneck intact. The survey of Cao et al. 6 identifies a unified operator framework handling all mapping patterns as an open problem; KrausKGE addresses this directly. A second family replaces explicit operators with nonlinear neural architectures. ConvE 11 applies 2D convolutions to reshaped embeddings; R-GCN 25 uses relational graph convolutions; KG-BERT 45 scores triples via BERT. These models recover multi-pathway expressiveness but abandon operator structure entirely, making multi-hop composition intractable without auxiliary encoders. KrausKGE sits between these two families: it retains explicit, composable operator structure while matching the multi-pathway expressiveness of neural models through concurrent Kraus operators. A third line deploys multiple operators per relation. NTN 28 uses k bilinear forms; MEIM 32 uses block

Read the complete text