Pre-Act: Multi-Step Planning and Reasoning Improves Acting in LLM Agents
Mrinal Rawat, Ambuje Gupta, Rushil Goomer, Alessandro Di Bari, Neha Gupta, Roberto Pieraccini · 2025
Read Pre-Act: Multi-Step Planning and Reasoning Improves Acting in LLM Agents by Mrinal Rawat, Ambuje Gupta, Rushil Goomer, Alessandro Di Bari, Neha Gupta, Roberto Pieraccini (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-09970.txt.
Introduction
Mrinal Rawat and co-authors give language model agents a planning step before they act, in a 2025 paper called Pre-Act. Standard agents reason and act in turns, but the plan only emerges as they go. Pre-Act instead drafts a multi-step plan with reasons up front, then revises it after each tool result until the task ends. The team scores agents both turn by turn and end to end.
Across five models, planning first raised action recall by about 70 percent over the standard approach on one dataset. Small models still struggled with the reasoning load, so the team fine-tuned two Llama sizes on the method. The tuned 70-billion model beat GPT-4 on action accuracy and goal completion.
Catalog record
| CREATOR | Mrinal Rawat, Ambuje Gupta, Rushil Goomer, Alessandro Di Bari, Neha Gupta, Roberto Pieraccini |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-09970
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pre-Act: Multi-Step Planning and Reasoning Improves Acting in LLM Agents Mrinal Rawat, Ambuje Gupta, Rushil Goomer, Alessandro Di Bari, Neha Gupta, Roberto Pieraccini Abstract The ReAct (Reasoning + Action) capability in large language models (LLMs) has become the foundation of modern agentic systems. Recent LLMs, such as DeepSeek-R1 and OpenAI o1/o3, exemplify this by emphasizing reasoning through the generation of ample intermediate tokens, which help build a strong premise before producing the final output tokens. In this paper, we introduce Pre-Act, a novel approach that enhances the agent’s performance by creating a multi-step execution plan along with the detailed reasoning for the given user input. This plan incrementally incorporates previous steps and tool outputs, refining itself after each step execution until the final response is obtained. Our approach is applicable to both conversational and non-conversational agents. To measure the performance of task-oriented agents comprehensively, we propose a two-level evaluation framework: (1) turn level and (2) end-to-end. Our turn-level evaluation, averaged across five models, shows that our approach, Pre-Act, outperforms ReAct by 70% in Action Recall on the Almita dataset. While this approach is effective for larger models, smaller models crucial for practical applications, where latency and cost are key constraints, often struggle with complex reasoning tasks required for agentic systems. To address this limitation, we fine-tune relatively small models such as Llama 3.1 (8B & 70B) using the proposed Pre-Act approach. Our experiments show that the fine-tuned 70B model outperforms GPT-4, achieving a 69.5% improvement in action accuracy (turn-level) and a 28% improvement in goal completion rate (end-to-end) on the Almita (out-of-domain) dataset. 1 Introduction Management of dialog systems has been a key focus of research in human-machine interaction. Various models have emerged, broadly categorized into distinct approaches Pieraccini and Huerta 2005 . Although inference and reinforcement-learning-based methods Levin and Pieraccini 1997 have been explored extensively, commercial applications have favored pragmatic solutions. Traditional rules-based or call-flow-driven systems Lieberman 1997 rely on predefined state transitions and procedural definitions. Although robust, they impose rigid dialog structures and require extensive manual design, leading to prolonged development cycles and high deployment costs, limiting scalability. With the emergence of LLM-driven agents, dialog systems have evolved beyond static rule-based flows. LLMs enable open-ended interactions where business users are not constrained by predefined prompts, fostering more flexible, goal-oriented conversations. Agentic AI Huang et al. 2024 acts autonomously, making decisions using advanced machine learning. However, effectiveness hinges on the underlying orchestrator, typically an LLM requiring strong reasoning and function-calling abilities. Recent models like DeepSeek-R1 DeepSeek-AI et al. 2025 and OpenAI o1/o3 generate additional reasoning-focused tokens and demonstrate these abilities, which is why approaches such as ReAct Yao et al. 2023b have become the primary foundation upon which today’s agentic frameworks are built. While ReAct provides a strong foundation for building agents, previous implementations had limitations. The reasoning component (generated as “thought") typically focuses only on the reasoning required for the immediate action, making it inadequate for handling complex tasks that require executing a sequence of actions. Although the LLM is the system’s cognitive backbone that drives reasoning, decision-making, and tool use, agent performance declines if the LLM orchestrator lacks intelligence or contextual awareness. Unfortunately, advanced reasoning remains largely restricted to proprietary models such as GPT-4 and Claude, limiting broader adoption. To address these limitations, we make the following contributions in this paper: • Pre-Act, an enhanced version of ReAct that improves agents performance by generating a multi-step plan along with detailed reasoning for each action for the given task. Steps are executed sequentially, incorporating past actions and observations as context, refining the plan until the final output is obtained. • A fine-tuning strategy leveraging datasets adapted for Pre-Act, enabling smaller models (e.g., Llama 8B, 70B) to match or surpass proprietary LLMs up to 20 times larger while reducing latency and cost, a critical aspect for real-world agentic applications. • A two-level evaluation: (a) turn-level, assessing whether predicted actions align with ground truth and (b) end-to-end, measuring goal completion and progress rate. Figure 1: Side-by-side comparison of ReAct and Pre-Act (our approach) for an example use-case from the Glaive dataset. While this example demonstrates a single tool call, the approach can be extended to multiple tool calls. 2 Related Work The concept of autonomous agents and agentic architectures is not new. The Open Agent Architecture Martin et al. 1999 , developed at SRI in the 1990s, enabled service creation through distributed autonomous agents coordinated by one or more facilitators. The Galaxy Architecture Seneff et al. 1998 , initially developed at MIT for spoken dialogue systems, became the reference for the DARPA Communicator program, using a central HUB to exchange messages with multiple specialized servers. Recent work has explored various strategies to enhance LLM reasoning and execution through advanced prompting techniques. Chain-of-Thought (CoT) prompting Wei et al. 2022b enables LLMs to break down complex problems into intermediate steps, while Self-Consistency Wang et al. 2023 improves reliability by generating multiple reasoning paths. ReAct Yao et al. 2023b integrates reasoning with action execution, further extended by Tree-of-Thought (ToT) Yao et al. 2023a and Graph-of-Thought Besta et al. 2024 , which introduce structured reasoning paths. Other approaches, such as Least-to-Most prompting Zhou et al. 2023 and Chain-of-Verification Dhuliawala et al. 2023 , enhance efficiency and reliability. However, these methods often generate redundant tokens and struggle with coherence across multiple steps, particularly in smaller models where computational efficiency is critical. Fine-tuning is emerging as an effective method for achieving strong performance while using fewer tokens in the prompt Ye et al. 2025 . Techniques such as instruction tuning Wei et al. 2022a and RLHF Ouyang et al. 2022 , when applied to smaller models with limited, but high-quality data, have shown promise in enhancing reasoning capabilities. However, these methods generally require datasets with explicit planning mechanisms to effectively learn structured reasoning and function-calling abilities, which are not readily available to the public and are difficult to obtain. In this work, we address these limitations by introducing structured plans along with detailed reasoning generated by LLM. While prior work has explored planning in LLMs Fu et al. 2023 , our approach extends it by generating a detailed multi-step plan with reasoning for each step, applicable to both conversational and non-conversational AI agents. Additionally, existing evaluation frameworks for LLM agents often assess either individual action accuracy Arcadinho et al. 2024 or overall task performance Gioacchini et al. 2024 , but not both. Our two-level evaluation framework provides a more comprehensive assessment, considering both granular actions and overall task success. 3 Approach 3.1 Incremental Multi-step planning While the ReAct approach has emerged as a fundamental paradigm for building LLM-based agents, its current implementation typically focuses on single-step reasoning and (immediate) action generation Yao et al. 2023b . For each input request, the agent iteratively performs up to n tool calls [0,n] before arriving at a final answer. Despite its effectiveness, this approach often struggles with complex tasks that require long-term planning and sequential decision-making. To address this limitation, we propose Pre-Act, which generates a comprehensive multi-step plan. Instead of generating isolated reasoning steps, our approach formulates a structured execution plan with the reasoning that not only integrates previously executed steps, but also outlines the forthcoming steps necessary