Semantic Interaction Information mediates compositional generalization in latent space
John Schwarcz · 2026
Read Semantic Interaction Information mediates compositional generalization in latent space by John Schwarcz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27134.txt.
Introduction
Schwarcz asks whether generalization can still fail once every key variable is known. The testbed is the Cognitive Gridworld, a task with hidden state driven by linked latent variables. Schwarcz defines Factorization Regret, an information measure of how latent interactions affect scores. The measure explains why echo state networks fall short there. It also exposes a failure mode where trust splits from accuracy. Representation Classification Chains then learn the interactions and variable values together. With interactions learned, made-up practice alone enables zero-shot control.
Catalog record
| CREATOR | John Schwarcz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69559 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.27134
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semantic Interaction Information mediates compositional generalization in latent space John Schwarcz Abstract Abstract Are there still barriers to generalization once all of the relevant variables are known? We address this question via a framework that casts compositional generalization as a variational inference problem over latent variables with parametric interactions. To explore this framework, we develop the Cognitive Gridworld , a stationary Partially Observable Markov Decision Process (POMDP) in which observations are generated jointly by multiple latent variables, yet feedback is provided only for a single goal variable. This setting allows us to describe Semantic Interaction Information : an information-theoretic quantity that measures the contribution of latent variable interactions to task performance. Using this metric, we first analyze Recurrent Neural Networks (RNNs) that are explicitly provided with the interactions and find that Semantic Interaction Information explains the accuracy gap between Echo State and Fully Trained networks. Additionally, our analysis uncovers a theoretically predicted failure mode, where confidence becomes decoupled from accuracy. These results suggest that utilizing the interactions between relevant variables is a non-trivial capability. We then address a harder regime where the interactions themselves must be learned by an embedding model. Learning how latent variables interact requires accurate inference, yet accurate inference depends on knowing those interactions; this circular dependence is characteristic of variational inference. The Cognitive Gridworld reveals this circularity as a potential challenge for continual meta-learning. We approach this dilemma via Representation Classification Chains (RCCs), a JEPA-style architecture which disentangles two processes: variable inference and variable embeddings are learned by separate modules through Reinforcement Learning and self-supervised learning, respectively. Lastly, we demonstrate that, by learning how variables interact, RCCs facilitate compositional generalization to novel combinations of relevant variables and offline learning in novel action spaces. Together, these results establish a theoretically grounded setting for researching, developing and evaluating goal-directed generalist agents. 1 Introduction As Machine Learning tackles increasingly difficult challenges, rigidity and unreliability remain a significant barrier to the development of generalist agents. A central obstacle is the fact that what can be learned depends crucially on what has been learned. For instance, inferring time of day from ambient light becomes significantly more reliable after learning about seasons (perhaps in order to explain changes in temperature). While a combinatorial explosion can emerge from interactions, only a small number of variables may be relevant to a given task. Therefore, the world could be compressed into something far more manageable, insofar as the goal-directed agent is concerned [ 99 , 80 ] . Similarly in nature, the knowledge an animal gains from an experience is shaped by internal objectives (hunger, safety, curiosity, etc) that constrain what will be learned from each experience. Nevertheless, animals develop a far better understanding of the world than modern reasoning models [ 96 , 71 ] , in part due to a remarkable intuition for how abstract variables interact. To address this shortcoming, we must be able to differentiate meaningful intelligence from that which is trivial. [ 18 ] defines intelligence as ’skill-acquisition efficiency’, emphasizing the capacity to build upon prior knowledge. This relies on the ability to recognize or propose an unseen combination of elements as a novel solution, known as compositional generalization. In this paper, we formalize compositional generalization with abstract variables as the elemental units, using the principle of Interaction Information – mutual information among three or more random variables [ 106 ] . Interaction information has been used to understand sensory modality integration [ 73 ] and causal inference [ 30 ] , but has not yet been put into a Reinforcement Learning (RL) framework. We bridge this gap by unifying Interaction Information with Semantic Information – the subset of information that is meaningful for survival [ 50 ] . To exemplify the relationship between Semantic Information and Interaction Information, consider an agent with two possible actions (i.e. causal interventions ), where reward r is determined by an exclusive or (XOR) operation between the agent’s action a and a hidden (i.e. latent ) binary variable c . XOR demonstrates Interaction Information in its purest form [ 79 ] : Action a and reward r are independent unless the agent knows the value of auxiliary variable c . We consider such variables as contextual since they mediate the dependencies between action, observations and reward, while not being directly causal. Here, we introduce Semantic Interaction Information (SII) – the contribution of Interaction Information between latent variables (and observables) to inference of the optimal action. More generally, SII emerges when conditioning on observables changes the mutual information between contextual variables and the optimal action. Conceptually, SII measures how much more certain an agent becomes about its goal by accounting for latent variable interactions, rather than treating them in isolation. Moreover, when variables interact in a systematic manner, an agent can use this to generalize to novel combinations of latent variables. In summary, we argue that meaningful intelligence can be made formal, through Information Theory and RL, as learning from inference in environments with compositional latent structure (often studied under the umbrella of meta-learning [ 85 , 38 , 51 ] ). Our support for SII as a mediator of meaningful intelligence can be split into three primary sections: (1) Cognitive Gridworld (CG): A minimal task that rewards agents for performing mental navigation in a compositional latent space. (2) Representation Classification Chains (RCCs): A novel architecture that consolidates experience into parametric embeddings to be used as building blocks for future learning. (3) Offline Optimization: A demonstration of the usefulness of RCCs for zero-shot control in novel spaces. 2 Related Works 2.1 Compositional Generalization Learning to interact with the environment was originally described by Classical Behaviorism [ 91 ] , and was formalized in RL as the reinforcement of actions that maximize internal reward (conditioned on the state of the world) [ 9 , 93 , 81 ] . Generalization in unambiguous environments can then be described as learning how independent dimensions of the state space interact in a manner that extrapolates to novel situations [ 34 ] . This capacity to recognize a novel combination of elements as a coherent whole is referred to as compositional generalization [ 47 , 52 ] . Compositional representations emerge naturally in recurrent networks trained to perform complex sensory predictions [ 10 ] . Other works explore how such representations may be formed by specialized regions of the brain. The Tolman-Eichenbaum Machine (TEM) [ 108 ] models the Hippocampus as a network that learns to navigate a grid of past experiences. The ”internal action” of navigating between sensory observations is proposed to convey their relationships and facilitate prediction. Similarly, models of animal behavior and perception describe sequential inference akin to navigation towards a ”decision boundary” [ 90 , 31 , 48 , 57 , 12 , 22 , 45 , 70 , 83 , 84 ] . This suggests that the internal ’commitments’ of a decision-making process can be treated as elemental units, allowing for compositional generalization to novel combinations of relevant decision-variables. A minimal task which allows researchers to design and manipulate hidden interactions could be a valuable tool for general intelligence research, complementary to the modern, large-scale benchmarks currently used [ 17 , 77 , 32 ]