State Representation and Termination for Recursive Reasoning Systems
Debashis Guha, Amritendu Mukherjee, Tarun Kumar · 2026
Read State Representation and Termination for Recursive Reasoning Systems by Debashis Guha, Amritendu Mukherjee, Tarun Kumar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06690.txt.
Introduction
Debashis Guha, Amritendu Mukherjee, Sanjay Kukreja, and Tarun Kumar address two design choices recursive reasoning systems usually leave implicit: how to represent the growing state of reasoning, and when to stop. Such systems alternate between gathering evidence and consolidating what they know. The authors represent state as an epistemic graph holding claims, evidential links, open questions, and confidence weights.
Their stopping signal is the order-gap, the distance between states reached by expanding then consolidating versus the reverse order; agreement suggests more iteration will not help. They prove exactly when the linearized gap is informative near a fixed point, stressing this is a local condition only. Sketched uses include agent loops, tree-of-thought reasoning, and theorem proving.
Catalog record
| CREATOR | Debashis Guha, Amritendu Mukherjee, Tarun Kumar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06690
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
State Representation and Termination for Recursive Reasoning Systems Thanks: S P Jain School of Global Management; [email protected] Debashis Guha, Amritendu Mukherjee, Tarun Kumar Abstract Recursive reasoning systems alternate between acquiring new evidence and refining an accumulated understanding. Two design choices are typically left implicit: how to represent the evolving reasoning state, and when to stop iterating. This paper addresses both. We represent the reasoning state as an epistemic state graph encoding extracted claims, evidential relations, open questions, and confidence weights. We define the order-gap as the distance between the states reached by expand-then-consolidate versus consolidate-then-expand; a small order-gap suggests that the two orderings agree and further iteration is unlikely to help. Our main result gives a necessary and sufficient condition for the linearised order-gap to be non-degenerate near the fixed point, showing when the criterion is informative rather than algebraically vacuous. This is a local condition, not a global convergence guarantee. We apply the framework to recursive reasoning systems and sketch its application to agent loops, tree-of-thought reasoning, theorem proving, and continual learning. Keywords. recursive reasoning; knowledge graph; state representation; iterative refinement; termination criterion; operator non-commutativity; convergence detection; long-context reasoning. 1. Introduction 1.1. Recursive Reasoning as Adaptive Inference A growing class of machine learning systems operates by iterative refinement rather than single-pass inference. At each step such a system acquires new information (a retrieved document, an observed action outcome, a sampled hypothesis, or a newly generated chain-of-thought step) and integrates it into an accumulated internal state before deciding whether to iterate further or commit to an output. This pattern appears in iterative retrieval-augmented generation ( Trivedi et al. 2023 ) , agent action-observation loops ( Yao et al. 2023a ) , recursive language models ( Zhang et al. 2025 ) , tree-of-thought and graph-of-thought reasoning ( Yao et al. 2023b ; Besta et al. 2023 ) , and continual learning ( Kirkpatrick et al. 2017 ) . We call this class recursive reasoning systems . Despite their diversity, recursive reasoning systems share a common structure. There is an internal state s_{t} representing what the system holds at step t . There is an expansion step that brings in new external evidence. There is a consolidation step that refines the state using only what is already present. And there is a termination decision: iterate further, or commit. 1.2. Two Missing Components In current systems, both the state and the termination criterion are handled implicitly or imposed from outside, and their absence leads to characteristic failure modes across four well-studied architectures as discussed below Chain-of-thought and tree-of-thought reasoning. Chain-of-thought prompting ( Wei et al. 2022 ) and its tree-structured extension ( Yao et al. 2023b ) represent the reasoning state as a text trace. There is no explicit record of which claims are supported, which are in conflict, and which remain unresolved. Contradictions accumulate without detection; reasoning drifts across steps; and there is no mechanism to revisit or revise earlier conclusions in light of later evidence. Termination is fixed by depth or iteration count, with no notion of reasoning being complete. Retrieval-augmented generation and multi-hop QA. Iterative retrieval systems such as IRCoT ( Trivedi et al. 2023 ) alternate between retrieving evidence and generating reasoning steps. Retrieved facts are not tracked relationally across iterations, provenance is not preserved in a structured way, and the system has no representation of what it still needs to find. This leads to redundant retrieval, missing critical evidence, and inconsistent synthesis across documents. Termination is a fixed hop count or token budget, with no signal whether further retrieval would change the answer or not. Agent action-observation loops. In ReAct-style agents ( Yao et al. 2023a ) , the state is a sequence of actions and observations with no canonical representation of goals, subgoals, or resolved versus unresolved tasks. This produces looping behaviour, repeated tool calls, and failure to recognise completion. Termination is an arbitrary maximum step count or manual stop condition. Iterative self-refinement. Self-Refine ( Madaan et al. 2023 ) and related approaches iterate a generate-critique-refine loop without an explicit representation of what has been fixed, what remains uncertain, or what is stable. Without such a state, the system has no signal for when further refinement is beneficial. Empirically, intrinsic self-correction without external feedback frequently fails to improve and can degrade performance ( Huang et al. 2023 ) : the system oscillates between answers, over-refines, or hallucinates improvements. Termination is a fixed iteration count or a subjective heuristic. Across all four cases, state is implicit in transient text or hidden activations rather than structured, persistent, and inspectable; and termination is imposed by fixed limits rather than derived from the system’s own trajectory. 1.3. The Proposal We propose treating state representation and termination as explicit design choices, and give concrete definitions to both. For state, we introduce the epistemic state graph ( Section 2 ): a structured graph whose nodes encode claims, partial answers, and open questions, and whose edges encode evidential support, logical dependency, and inconsistency, all weighted by confidence. This representation is structured, persistent, and inspectable across iterations. For termination, we introduce the order-gap ( Section 5 ): a criterion derived from the system’s own operator structure that measures whether the system’s state is still sensitive to the ordering of expansion and consolidation. When the order-gap is small, both orderings produce nearly the same result, suggesting that further iteration is unlikely to matter. When it is large, the ordering still matters and the system has not yet settled. 1.4. Contributions 1. State representation ( Section 2 ). The epistemic state graph, with a smooth Euclidean embedding that makes the expansion and consolidation operators amenable to analysis. 2. Operator framework ( Section 3 ). Formal definitions of the expansion operator P_{e} and consolidation operator Q on the epistemic state, with their dynamics and key properties. 3. Order-gap termination ( Section 5 ). The order-gap termination criterion, a windowed stopping rule, and a non-degeneracy theorem ( Proposition 5.2 ) characterising when the criterion is informative. 4. Stopping algorithm ( Section 6 ). Pseudocode for recursive reasoning with order-gap termination. 5. Other recursive reasoning systems ( Section 8 ). How the framework applies to agent loops, tree-of-thought reasoning, theorem proving, and continual learning. 6. Illustration ( Section 9 ). A closed-form 2-dimensional example verifying the dynamics and order-gap formula. 2. State Representation 2.1. Requirements for a Reasoning State A recursive reasoning system iterates by processing new evidence and refining its accumulated understanding. The state must support two operations: expansion, which adds information from a new piece of evidence; and consolidation, which refines what is already present. For both operations to be principled, the state must make their inputs and outputs explicit. Expansion needs to know what is already established (to avoid redundancy) and what is still open (to direct retrieval). Consolidation needs to know which claims conflict (to resolve them) and which are mutually supporting (to strengthen them). The following six objects are the minimum needed to support both operations correctly: • Claims : extracted facts, with their provenance and confidence. • Evidential relations : which claims support which others, and how strongly. • Conflicts : which claims are inconsistent with each other. • Partial conclusions : the system’s