Locally Coherent, Globally Incoherent: Bounding Compositional Incoherence in Multi-Component LLM Agents
Anany Kotawala · 2026
Read Locally Coherent, Globally Incoherent: Bounding Compositional Incoherence in Multi-Component LLM Agents by Anany Kotawala (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30335.txt.
Introduction
Anany Kotawala studies multi-part LLM agent failure: each part sound, yet the joint quote breaks odds rules. He names the gap the compositional residual, the L2 gap to the sound-odds set, worked out at run time. A Boyle-Dykstra fix repairs the quote, and an e-process tracks soundness. Over 1,876 cliques, the gap is above zero on 33 to 94 percent of cliques. This means about a tenth of a nat per bet on 1,770 bets. The gain falls to near zero for self-fixing bettors.
Catalog record
| CREATOR | Anany Kotawala |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 108738 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30335
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Locally Coherent, Globally Incoherent: Bounding Compositional Incoherence in Multi-Component LLM Agents Anany Kotawala Abstract Multi-component LLM agents assemble probabilistic claims from components that each see only part of a joint problem; the composition can violate basic probability axioms even when every component is locally coherent. We formalise this locally coherent, globally incoherent failure via the compositional residual ε ⋆ \varepsilon^{\star} , the L 2 L_{2} distance from the composed quote to the joint coherent polytope, computable at runtime from system output and the declared cross-component coupling constraints. A product-structure dichotomy characterises when local coherence suffices, and a Rayleigh-quotient prediction matches the observed residual within 7 % 7\% on three of four relation classes. A hierarchical Boyle–Dykstra projection repairs the composition deterministically; an anytime-valid e-process gives sequential coherence monitoring. Across 1,876 1{,}876 ensemble cliques on a four-LLM mid-tier panel (frontier-panel rerun in § 5.5 ), ε ⋆ > 0 \varepsilon^{\star}\!>\!0 on 33 33 – 94 % 94\% of cliques, translating to + 0.115 +0.115 nats per bet of regret on 1,770 1{,}770 resolved bets under the proportional allocation rule (the gain collapses to + 0.006 +0.006 under bettors that themselves coherentise). Three intuitive LLM-side mitigations (retrieval, partition-aware prompting, aggregator-LLM) each fail or regress. 1 Introduction Foundation-model evaluation routinely reports per-question accuracy, calibration, and proper-scoring statistics; formal, instance-wise guarantees on system-level performance under composition of multiple model calls are comparatively scarce. In multi-component agents, planners route retrieval, arithmetic, and probability assessment to specialist subagents or tools, and each component handles only part of a joint question. Even when every component is calibrated and internally coherent on its assigned questions, the aggregated belief need not be: a research component emitting P(\text{Republican}){=}0.6 and a forecasting component emitting P(\text{Democrat}){=}0.6 produce a 1.2 -mass quote that no probability measure can assign, inducing a Dutch-book exposure ( 6 ) that arises strictly between components. Per-component coherence does not, in general, repair the composed system; we call this regime locally coherent, globally incoherent ; Figure 1 shows a concrete instance from the planner-discretion harness of § 5.3 . p_{i} 0.00 0.25 0.50 0.75 0.39 0.73 0.67 0.71 infra. model apps other partition outcome \sum_{i}p_{i}\!=\!1 (constraint) \sum_{i}p_{i}\!=\!2.50 Figure 1 : A locally coherent, globally incoherent failure. Four specialists are routed one outcome each of the partition “Largest US AI startup IPO 2026” (infrastructure, model labs, applications, other; from § 5.3 ). Each specialist sees only its assigned sector as a single Bernoulli question, quotes a locally well-calibrated probability, and the agent assembles the four quotes. No specialist saw that the sectors tile the field; the assembled mass is 2.50 and \varepsilon^{\star}\!=\!0.749 certifies the failure. Per-component calibration, self-consistency ( 17 ) , and conformal prediction ( 2 ) act on individual model outputs and preserve only per-output coherence properties; cross-component logical constraints are invisible to all three. We identify the compositional residual \varepsilon^{\star} , the L_{2} distance from the composed quote to the joint coherent polytope, as a runtime, distribution-free certificate of system-level coherence under owner-selected aggregation; it is computable from the composed quote and the cross-component constraints alone. As a constructive repair preserving specialist routing, we use a hierarchical Boyle–Dykstra projection. We pair these with closed-form bounds, an anytime-valid sequential test, and a decomposable benchmark whose hardness is predicted by the theory. A product-structure dichotomy ( Theorem 3.3 ) characterises when local coherence suffices: under owner-selected aggregation (each component owns a subset of joint coordinates; the aggregator just selects what each owner already wrote), component coherence guarantees system coherence for all inputs if and only if the joint polytope factorises as a Cartesian product of local polytopes. Under any tighter coupling, locally coherent component forecasts exist whose composition is globally incoherent, and \varepsilon^{\star} certifies this failure mode (Cor. 3.4 ). Cor. 3.9 converts the existential dichotomy into a closed-form magnitude prediction (Rayleigh-quotient form) computable from the specialist panel covariance alone. Operationally, \varepsilon^{\star} yields a bound \mathrm{Exposure}^{\star}\!\leq\!\sqrt{m^{\star}}\,\varepsilon^{\star} (Cor. 3.5 ) on system-level Dutch-book exposure under the Fundamental Theorem of Asset Pricing (FTAP); the hierarchical Boyle–Dykstra repair ( Theorem 3.10 ) drives this bound to the numerical floor, and the corresponding e-process (a sequential test controlling false positives at any stopping time) gives an anytime-valid coherence test (§ 3.7 , Theorem D.2 ). The convex-analytic machinery is classical; the contribution is the operational reframing of \varepsilon^{\star} as a runtime certificate, the dichotomy of Theorem 3.3 , the falsifiable magnitude prediction of Cor. 3.9 , and the decomposable benchmark whose hardness ordering the theory predicts. Empirically, we evaluate 1{,}876 ensemble cliques drawn from Paleka ( 11 ) and Polymarket across four contemporary foundation models, stratified by four logical-relation classes. The empirical hardness ordering (partition > negation > disjunction > conjunction) tracks how tightly each polytope constrains the joint quote, as predicted by Theorem 3.3 , and Cor. 3.9 ’s magnitude prediction matches the observed expected residual within 7\% on three of the four relation classes (the conjunction under-shoot at 0.83\!\times is itself predicted by the Cor. 3.9 interior- \bar{\Pi} regime). The exposure bound \sqrt{m^{\star}}\varepsilon^{\star} averages 0.137 under naive composition ( Figure 2 b) and is reduced to the QP solver floor by hierarchical projection. We report per-cell Brier with Diebold–Mariano significance (the standard paired test for forecast comparison), and validate with a same-model decoupling control, leakage filtering, and a tool-augmented A/B; full protocols and a reproducibility manifest are in the appendices. 2 Preliminaries Throughout, starred objects denote the composed system, while subscripts denote individual components. Cliques and the coherent polytope. A clique C is a tuple (Q_{1},\dots,Q_{m},R) of m Bernoulli questions and logical relations R . By 6 , the set \mathcal{M}_{C}=\{r\in[0,1]^{m}:\exists\,\mu\in\Delta(\{0,1\}^{m})\ \text{consistent with }R\} is a closed convex polytope. We denote the L_{2} projection \Pi_{C}:[0,1]^{m}\to\mathcal{M}_{C} and the residual \varepsilon_{C}(\hat{p}):=\|\hat{p}-\Pi_{C}(\hat{p})\|_{2} . K -sample empirical marginal. A forecaster supplies K i.i.d. samples per question, yielding \hat{p}\in[0,1]^{m} with \hat{p}_{j}=K^{-1}\sum_{k}Y_{j,k} and population limit p_{F}:=\lim_{K\to\infty}\hat{p} . Generically \hat{p}\notin\mathcal{M}_{C} even when p_{F}\in\mathcal{M}_{C} (due to finite-sample fluctuation). Within-component JCD. Joint-Coherent Decoding is the L_{2} projection of K -sample LLM marginals onto the local coherent polytope \mathcal{M}_{C} . The compositional layer treats JCD as the local repair operator; it inherits a Pythagorean Brier improvement (Theorem A.1 , App. A ) and a finite-state no-Dutch-book bound via the Fundamental Theorem of Asset Pricing (FTAP; Cor. A.2 ) bounded by m\cdot\varepsilon^{\mathrm{KKT}}\!\leq\!1.4\!\times\!10^{-5} at the default tolerance of OSQP , the quadratic-program solver we use throughout. Multi-component agent. The agent has k sub-models indexed by a\in[k] . Sub-model a emits an empirical marginal \hat{p}^{(a)}\in[0,1]^{m_{a}} on its local question set \mathcal{Q}_{a} with local polytope \mathcal{M}_{a}\subseteq[0,1]^{m_{a}} ; component-level JCD produces \Pi_{a}(\hat{p}^{(a)})\in\mathcal{M}_{a} . The agent’s joint question set is \mathcal{Q}^{\star}=\bigcup_{a}\mathcal{Q}_{a} with size m^{\star}=|\mathcal{Q}^{\star}| and joint polytope \mathcal{M}^{\star}\subseteq[0,1]^{m^{\star}} , which respects (i) each local relation lifted to \mathcal{Q}^{\star} and (ii) all cross-component coupling constraints \mathcal{C} : identifications of shared questions, cross-component logical relations like Q^{\star}=Q_{a}\wedge Q_{b} , and partitions spanning components. Aggregator. An aggregator \mathcal{A}:\prod_{a}[0,1]^{m_{a}}\to[0,1]^{m^{\star}} assembles the agent’s quoted marginal vector. The aggregator \mathcal{A} is the owner-selected coordinate selector of Definition 3.2 ; this covers the specialist-routing and tool-call composition patterns used in our experiments. We focus on owner-selection because it is the practical pattern under compute budgets: each component owns a subset of joint coordinates and there is no redundant elicitation across specialists. A coord-wise averaging