Bridging the Reasoning Gap: Small LLMs Can Plan with Generalised Strategies

Andrey Borro, Patricia J Riddle, Michael W Barley, Michael J Witbrock · 2025

Read Bridging the Reasoning Gap: Small LLMs Can Plan with Generalised Strategies by Andrey Borro, Patricia J Riddle, Michael W Barley, Michael J Witbrock (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18817.txt.

Introduction

Andrey Borro, Patricia J Riddle, Michael W Barley, and Michael J Witbrock ask how small language models can plan better, in a 2025 arXiv paper. Big models reason well but cost much to run. The team tests two cheap ways to lift the skills of smaller models.

First, a big model writes a general strategy for a task type, and the small model follows it. Second, the small model is asked again and again to fix errors in its own answers. On planning and math tasks, these steps raised small models to near the level of big ones at far lower cost. Using strategies also cut the small model's cost by nearly 30 percent.

Catalog record

CREATORAndrey Borro, Patricia J Riddle, Michael W Barley, Michael J Witbrock
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18817

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging the Reasoning Gap: Small LLMs Can Plan with Generalised Strategies Andrey Borro, Patricia J Riddle, Michael W Barley, Michael J Witbrock Abstract Recent advancements in the reasoning skills of Large Language Models (LLMs) demonstrate an increase in the ability of LLMs to solve simple planning tasks. However, as long as the driving force behind improved reasoning capability is the size and complexity of the model, the financial and computational costs associated with running them will also increase. This trend raises questions about continued accessibility and whether these improvements will increase at the same pace as models continue to grow in size and expense. We propose two approaches to enhance the reasoning ability of less resource-intensive LLMs. (1) Provide them with a generalised strategy for solving tasks within a given domain, generated by a more resource-intensive LLM. (2) Exploit their cost-effectiveness by iteratively prompting these models to correct errors in their proposed solutions. Our empirical results from planning and mathematical reasoning tasks demonstrate that these methods improve the performance of less resource-intensive LLMs to levels comparable with their more resource-intensive counterparts, at a fraction of the cost. Additionally, we show that the utilisation of generalised strategies in our experiments reduced the cost of the less resource-intensive model by nearly 30 percent on average. 1 Introduction The emergence of reasoning capabilities in Large Language Models (LLMs) has prompted research into their ability to solve a wide variety of problems Bubeck et al. (2023) ; Zhao et al. (2024) ; Yu et al. (2022) . Further research into prompt engineering Clavié et al. (2023) and prompting techniques such as Chain-of-Thought Wei et al. (2022) has improved the ability of pre-trained LLMs to solve reasoning tasks without fine-tuning. Despite these advances, many LLMs still perform poorly on System 2 Kahneman (2011) reasoning tasks in maths, logic, and planning. LLMs empowered with internal reasoning steps, such as OpenAI’s o1 OpenAI (2024) , which iteratively feeds its own output back in as input for Chain-of-Thought-like reasoning, have shown promise in solving planning tasks, overcoming some limitations previously faced by LLMs. However, as evidenced by recent work Valmeekam et al. (2024) , these successes are restricted to small-scale tasks within simple and transparent domains. Furthermore, there is a clear correlation between the size, computational requirements, and financial cost of an LLM and its performance on planning tasks. For example, when tasked with manipulating a small handful of blocks on a table, the weaker and more affordable o1-mini can solve less than half of the tasks solved by the more powerful and expensive o1. Progress in improving the reasoning capabilities of LLMs through the development of more resource-intensive models is beneficial. However, it is important to recognise that data is finite, and the continued returns on scaling models with increased amounts of data, greater compute power, or more parameters remain uncertain. Additionally, rising financial and computational demands render such models less accessible. This serves to widen the gap with traditional planning systems, such as FastDownward Helmert (2011) , which is capable of solving planning tasks with negligible operating costs and in a small fraction of the time taken by an LLM while guaranteeing solution optimality and correctness. We propose an approach to augment the reasoning abilities of weaker models by applying the expertise of more powerful models. This is accomplished by prompting the more powerful model to generate a generalised strategy for solving tasks within a given domain. The strategy is then integrated as additional non-parameterised knowledge into the input text of the weaker model. This has a substantial effect on the average cost of solving a task in cases where the cost of generating the strategy can be amortised across several tasks. Additionally, we explore a complementary technique that further boosts model performance by identifying errors in its solutions and prompting it to make corrections accordingly. Our methods are capable of strongly improving the performance of weaker LLMs on reasoning tasks such as planning and maths. In our experiments, weaker models utilising our methods consistently performed at a level similar to the more powerful model used as the baseline, for a fraction of the cost. Furthermore, we show that even for the same model, the incorporation of a generalised strategy into the task prompt reduces reasoning token costs by 50 percent when solving tasks with four rounds of error correction and by 30 percent without. We demonstrate that our methods can be extended beyond planning tasks to mathematical reasoning by solving 95 percent of a challenging CRT dataset Xie et al. (2024) . This result outperforms the more powerful model used as the baseline by 20 percentage points, for less than one-tenth of the cost. 2 Background 2.1 Automated Planning Automated Planning is a branch of Artificial Intelligence primarily focused on the generation of plans. Plans are sequences of actions within a given environment that can be sequentially applied to an initial state. As this paper explores the ability of LLMs to generate solutions to planning tasks, the words plan and solution are used interchangeably. A planning task \Pi is a 6-tuple (S,s_{i},S_{g},A,f_{a},f_{t}) consisting of: • A finite and discrete set of all states S , also known as the state space. • The initial state s_{i}\in S . • The set of goal states S_{g}\subseteq S . • The set of actions A . • The applicability function f_{a} , which returns f_{a}(s)\subseteq A , i.e. the set of all actions applicable at state s . • The transition function f_{t} , which maps a state s and applicable action a to the resultant state s^{\prime} of applying a to s , such that s^{\prime}=f_{t}(s,a) , a\in f_{a}(s) . In practice, most planning systems Pohl (1970) ; Jiang (2021) perform graph search on a graph G=(V,\,E) , where V is the set of vertices and E is the set of edges. Vertices are states s\in S , while edges are formed from the transition function f_{t} , where \forall\,u,v\in V,\quad(u,v)\in E\iff\exists\,a\in A\colon f_{t}(u,a)=v. A correct solution for a given planning task is a plan a_{1}...a_{n} such that one can form a path v_{0}...v_{n} through G , where v_{i}=f_{t}(v_{i-1},\,a_{i}) , v_{0}=s_{i} and v_{n}=s_{g}\in S_{g} ; that is, a plan that transforms s_{i} into s_{g} when applied sequentially. Heuristics Hart et al. (1968) ; Lenat (1982) are often used to guide the search and reduce the number of vertices that must be visited for a solution to be found. The Planning Domain Definition Language (PDDL) Ghallab et al. (1998) is a formal language that is widely used for the representation of domains and tasks in planning. In our experiments, the descriptions of planning tasks, states, domains, actions, and plans are represented in PDDL within our prompts and in the final output of the LLM. However, a full understanding of our research does not require prior knowledge of PDDL. 2.2 Large Language Models Large Language Models (LLMs) Chen et al. (2021) ; Chang et al. (2024) ; Zhao et al. (2023) are very large neural networks, typically containing billions of parameters. These models are trained through unsupervised learning on vast corpora of human-written text to effectively process long text sequences in parallel and capture non-contiguous word dependencies. Prompt

Read the complete text