Profile-Then-Reason: Bounded Semantic Complexity for Tool-Augmented Language Agents
Paulo Akira F. Enabe · 2026
Read Profile-Then-Reason: Bounded Semantic Complexity for Tool-Augmented Language Agents by Paulo Akira F. Enabe (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04131.txt.
Introduction
Paulo Akira F. Enabe introduced Profile-Then-Reason, a bounded execution framework for language-model agents that use external tools. Instead of recomputing reasoning after every observation, the model first drafts an explicit workflow, guarded operators run it, a verifier checks the trace, and repair runs only when the workflow fails. In the nominal case the pipeline needs just two language-model calls, three at worst. Against ReAct across six benchmarks and four models, it won the pairwise exact-match comparison in 16 of 24 configurations.
Catalog record
| CREATOR | Paulo Akira F. Enabe |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72279 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.04131
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Profile-Then-Reason: Bounded Semantic Complexity for Tool-Augmented Language Agents Paulo Akira F. Enabe Abstract Large language model agents that use external tools are often implemented through reactive execution, in which reasoning is repeatedly recomputed after each observation, increasing latency and sensitivity to error propagation. This work introduces Profile–Then–Reason (PTR), a bounded execution framework for structured tool-augmented reasoning, in which a language model first synthesizes an explicit workflow, deterministic or guarded operators execute that workflow, a verifier evaluates the resulting trace, and repair is invoked only when the original workflow is no longer reliable. A mathematical formulation is developed in which the full pipeline is expressed as a composition of profile, routing, execution, verification, repair, and reasoning operators; under bounded repair, the number of language-model calls is restricted to two in the nominal case and three in the worst case. Experiments against a ReAct baseline on six benchmarks and four language models show that PTR achieves the pairwise exact-match advantage in 16 of 24 configurations. The results indicate that PTR is particularly effective on retrieval-centered and decomposition-heavy tasks, whereas reactive execution remains preferable when success depends on substantial online adaptation. 1 Introduction Large language models have emerged as a central paradigm in modern artificial intelligence due to their ability to learn broad linguistic, semantic, and procedural regularities from large-scale text corpora. Their recent development is rooted in the Transformer architecture introduced in [ 4 ] , in which sequence modeling is based on self-attention rather than recurrence or convolution. This architectural shift enabled substantially improved scalability in both training and inference, thereby making it possible to train models with very large parameter counts and broad task generalization capabilities. As a consequence, contemporary language models are able not only to generate coherent natural language, but also to perform instruction following, structured prediction, code generation, tool invocation, and multi-step reasoning. These capabilities have motivated the development of agentic frameworks in which a language model is no longer used solely as a text generator, but rather as a decision-making component embedded within a larger computational pipeline. A major step in the development of reasoning-oriented prompting was the introduction of chain-of-thought prompting in [ 1 ] . In that formulation, the model is no longer prompted to produce only an input-output mapping, but instead to generate a sequence of intermediate natural-language reasoning steps leading to the final answer. The significance of this contribution lies in showing that large language models can be induced, through prompting alone, to externalize part of their reasoning process in a form that is both operationally useful and partially interpretable. More precisely, chain-of-thought prompting demonstrated that the insertion of intermediate linguistic steps can improve performance on arithmetic, commonsense, and symbolic reasoning tasks, especially for models of sufficiently large scale [ 1 , 2 ] . In this sense, classical chain-of-thought prompting established the basic principle that reasoning quality can be improved by structuring the output space of the model, rather than by requesting only the final prediction. At the same time, the resulting reasoning process remains internal to a single language-model trajectory and does not, by itself, define an explicit execution framework for tool use, state transitions, or bounded interaction with external operators. A subsequent line of work extended chain-of-thought reasoning beyond the generation of intermediate steps alone and toward explicit verification-oriented deliberation. In particular, the Chain-of-Verification framework proposed in [ 3 ] considers a staged procedure in which the model first generates a draft response, then formulates verification questions, answers those questions independently, and finally revises its response in light of the obtained evidence. This development is closely related to chain-of-thought prompting in that it retains the central idea that intermediate reasoning structure can improve output quality. However, its objective is different. Rather than primarily eliciting latent reasoning ability for difficult tasks, it introduces an explicit self-checking mechanism aimed at reducing factual hallucination and improving response reliability. In this sense, Chain-of-Verification may be viewed as a verification-centered extension of the broader reasoning-by-decomposition paradigm initiated by classical chain-of-thought prompting. A further development of particular importance for agentic systems is the ReAct framework introduced in [ 5 ] . In contrast to classical chain-of-thought prompting, where the reasoning process remains internal to a single generative trajectory, ReAct interleaves natural-language reasoning traces with explicit task-specific actions executed in an external environment. More precisely, the model alternates between producing thoughts, which serve to decompose goals, track progress, or reformulate plans, and actions, which query an external source or modify the environment and thereby produce new observations [ 5 ] . This coupling is methodologically significant because it allows reasoning to guide action selection while simultaneously allowing environmental feedback to update subsequent reasoning. In this sense, ReAct constitutes one of the first general prompt-based formulations in which large language models are used not only to explain intermediate reasoning steps, but also to support sequential decision making through explicit interaction with tools or environments. The empirical study in the paper demonstrated that such an interleaved reasoning-and-acting process can improve performance. Despite its conceptual appeal and broad applicability, ReAct also exhibits structural limitations that become significant in tool-intensive settings. Because reasoning traces and external actions are interleaved sequentially, the framework typically requires a new language-model inference step after each observation, so that the overall computational cost and wall-clock latency grow with the length of the trajectory. This dependence on repeated model calls is not incidental, but intrinsic to the reactive formulation itself: each newly acquired observation may alter the subsequent reasoning state, which in turn necessitates further deliberation before the next action is selected [ 5 ] . As a consequence, ReAct can be inefficient on tasks whose workflow is largely predictable in advance, since repeated semantic recomputation is performed even when intermediate observations only induce local parameter adjustments rather than genuine strategy changes. The same sequential dependence may also reduce robustness, as early retrieval errors, uninformative observations, or hallucinated intermediate thoughts can propagate through later steps of the trajectory. Indeed, the ReAct study reports error modes related to hallucination, reasoning error, and non-informative search. Related analyses have shown that these limitations are not confined to the original ReAct setting, but persist more broadly in reactive agent frameworks, particularly in the form of planning failures, error propagation, and efficiency overheads [ 6 , 7 , 8 , 9 ] . Two recent works are particularly relevant in the search for alternatives to fully reactive agent execution. ReWOO [ 10 ] proposes to decouple reasoning from observations by introducing a modular Planner–Worker–Solver architecture. The planner generates a complete sequence of interdependent plans before any tool feedback is incorporated, the worker executes the corresponding tool calls, and the solver combines the collected evidence into a final response. The principal motivation is to avoid the prompt redundancy and repeated language-model invocations induced by observation-dependent reasoning. By contrast, LLMCompiler [ 11 ] addresses the same general inefficiency problem from a systems perspective. Its formulation introduces a function-calling planner, a task-fetching unit, and an executor that collectively transform a user query into a dependency graph of tasks and execute compatible function calls in parallel. Thus, while both methods depart from the strictly sequential thought-action-observation pattern, ReWOO does so through prior decomposition of reasoning