Separable Pathways for Causal Reasoning: How Architectural Scaffolding Enables Hypothesis-Space Restructuring in LLM Agents

John Alderete, Sebastian Benthall, Connie Xu, John Xing · 2026

Read Separable Pathways for Causal Reasoning: How Architectural Scaffolding Enables Hypothesis-Space Restructuring in LLM Agents by John Alderete, Sebastian Benthall, Connie Xu, John Xing (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-20039.txt.

Introduction

Alderete and three colleagues test whether scaffolding lets LLM agents revise their hypothesis space, not just update beliefs within it. Their two-part design pairs context graphs, typed state machines that structure search, with dynamic behaviors that spot weak hypotheses and expand them at runtime. Across 1,085 trials the parts help differently. Context graphs drive post-switch thinking quality, making up 94 percent of the accuracy gain, while the dynamic part keeps the agent ready to think by catching regime shifts early.

Catalog record

CREATORJohn Alderete, Sebastian Benthall, Connie Xu, John Xing
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE90604
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.20039

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Separable Pathways for Causal Reasoning: How Architectural Scaffolding Enables Hypothesis-Space Restructuring in LLM Agents John Alderete, Sebastian Benthall, Connie Xu, John Xing Abstract Causal discovery through experimentation and intervention is fundamental to robust problem solving. It requires not just updating beliefs within a fixed framework but revising the hypothesis space itself, a capacity current AI agents lack when evidence demands representations they have not previously constructed. We extend the blicket detector paradigm from developmental science to test this capacity in AI agents equipped with architectural scaffolding that targets hypothesis-space restructuring. Our compositional architecture has two discrete components: context graphs, which structure exploration as typed state machines, and dynamic behaviors, which monitor for evidence that the current hypothesis space is inadequate and expand it at runtime. Across 1,085 experimental trials, these components make orthogonal contributions: context graphs drive reasoning quality within the post-switch hypothesis space, accounting for 94% of the accuracy gain, while dynamic behaviors drive reasoning eligibility by detecting regime changes and preventing premature commitment to outdated hypotheses. 1 Introduction Causal reasoning is the capacity to construct, test, and revise explanatory models of the world. This reasoning underpins generalization, efficient exploration, and robust adaptation in ways that associative learning alone cannot enable ( 28 ; 32 ) . Developmental studies show that even young children leverage causal models to learn from sparse evidence ( 9 ; 12 ) , actively constructing interventions to disambiguate competing hypotheses rather than passively accumulating observations ( 27 ) . For agentic AI systems that must act under uncertainty and learn from their own interventions, this capacity is what distinguishes robust problem-solving from brittle pattern matching ( 30 ; 22 ) . Yet current AI systems exhibit a striking gap in precisely this capability. While LLMs can generate correct causal arguments with high probability ( 21 ) , this performance reflects causal knowledge from training corpora rather than genuine discovery through intervention. 37 described this as “cultural transmission”: the aggregation and retransmission of human-generated knowledge, fundamentally different from the capacity to discover novel causal structure. 38 reached a similar conclusion through so-called meta structural causal models, finding that LLMs reproduce correlations over causal facts encountered during training. Empirical evaluations confirm this pattern: LLMs perform near chance on causal inference tasks that cannot be solved by retrieval ( 17 ) , and their apparent causal competence degrades on questions post-dating training data ( 5 ) ; see Section 2.1 for a detailed review. Larger models retrieve more causal facts; they do not acquire the capacity to revise their causal framework when those facts prove inadequate. What would genuine causal reasoning require? Developmental research offers a precise answer. Children do not simply learn which variables are causal within a fixed rule structure. They learn to revise the rule structure itself, forming and revising abstract “overhypotheses”, or beliefs about the kind of causal rule that governs a domain ( 12 ) . 18 formalized overhypothesis learning as hierarchical Bayesian inference, showing that learners can acquire abstract structural knowledge (e.g., “this domain uses conjunctive rules”) from the same data used for first-order learning (e.g., learning which specific variables are causal). A key result of this and related work is that acquiring the right hypothesis space often accelerates learning more than improved selection within a fixed one ( 34 ) . In the hierarchical Bayesian framework, these levels are unified: the same inference process that updates first-order beliefs also updates the higher-order hypothesis space. The compositional architecture evaluated here takes a different approach, factorizing the problem into two discrete components whose contributions are empirically isolable. One component structures inference within a fixed hypothesis space, what we term reasoning quality . The other component, reasoning eligibility , monitors for evidence that the space itself is inadequate and expands it by adding representational dimensions that the agent’s state space did not previously contain. We refer to this expansion as hypothesis-space restructuring . This is not a reweighting of hypotheses within a fixed representational vocabulary but an expansion of the vocabulary itself by adding dimensions that the agent’s state space did not previously contain. Our central claim is that this factorization is productive: the two components will make orthogonal contributions to distinct failure modes. We instantiate them as components of a compositional architecture designed so that each layer’s contribution is empirically isolable through ablation. Context graphs, drawing on statechart formalisms ( 15 ) , structure the agent’s problem-solving process as an explicit graph of reasoning phases, supporting reasoning quality within a fixed hypothesis space. Dynamic behaviors, rooted in runtime verification ( 23 ) , operate as monitors layered on top of the state machine, detecting when the current hypothesis space cannot account for the evidence and triggering state-space reorganization. Together they provide the machinery for hypothesis-space restructuring. To evaluate this architecture, we extend the blicket detector paradigm, originally developed to study causal learning in children ( 11 ; 9 ) and formalized for computational agents by 20 . In the standard task, an agent must discover which objects activate a novel machine and what rule governs activation. We introduce conditions that require hypothesis-space restructuring: the generative rule changes mid-experiment and the agent must discover that new causal dimensions are relevant, not simply re-evaluate existing variables. This article makes three contributions: • The Extended Blicket Benchmark. We extend the 20 paradigm into a parameterized evaluation suite that tests hypothesis-space restructuring specifically, introducing a novel hidden moderator condition where the causal rule changes mid-experiment. We also contribute a diagnostic metric, reasoning-eligible accuracy , that disentangles structural traps from genuine reasoning failures. 1 1 1 The benchmark codebase, all agent implementations, trace data, and analysis scripts will be made publicly available upon acceptance. • The Separable Pathways Finding. We show that the two architectural components make orthogonal contributions: context graphs drive reasoning quality within the post-switch hypothesis space, while dynamic behaviors drive reasoning eligibility by detecting regime changes and preventing premature commitment to outdated hypotheses. Neither substitutes for the other. • Boundary Conditions. The architectural advantage is specific to hypothesis-space restructuring. The benchmark includes two additional extended conditions on which the current scaffolding provides no reliable benefit: order-sensitive (placement sequence is causally relevant) and stochastic (activation is probabilistic). These null results establish where the architecture’s coverage ends and serve as diagnostic targets for future enrichment. 2 Related Work 2.1 Causal Learning, Overhypotheses, and the Blicket Paradigm The so-called theory-theory framework established that children construct and revise causal models of their environment, treating learning as a process of theory change rather than associative accumulation ( 9 ; 12 ) . An important experimental design for this work is the blicket detector paradigm ( 11 ) . In this paradigm, the detector is a device that activates (lights up, plays music) when certain objects, called blickets, are placed on it according to a hidden causal rule controlled by the experimenter. The participant explores the environment by placing and removing objects, observing activation feedback, and forming hypotheses about which objects are causally active and how. Dependent measures across two decades of blicket studies include object-level categorization (“Is this a blicket?”), novel intervention design (“Make the machine go/stop”), and exploration behavior metrics such as steps to activation and exploration strategy

Read the complete text