Are Retrials All You Need? Enhancing Large Language Model Reasoning Without Verbalized Feedback
Nearchos Potamitis, Akhil Arora · 2025
Read Are Retrials All You Need? Enhancing Large Language Model Reasoning Without Verbalized Feedback by Nearchos Potamitis, Akhil Arora (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12951.txt.
Introduction
Nearchos Potamitis and Akhil Arora ask whether language models reason better simply by trying again, in a 2025 paper. Many frameworks coach models to critique and rewrite their own answers in words. That coaching costs extra computing and complexity.
The simpler idea is the retrial: when an answer checks out wrong, start over fresh. No written feedback or self reflection is needed. Across their tests, plain retrials often beat the fancier critique loops. The result questions whether complex reasoning schemes earn their cost. Sometimes the best fix for a wrong answer is just another honest attempt.
Catalog record
| CREATOR | Nearchos Potamitis, Akhil Arora |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-12951
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Are Retrials All You Need? Enhancing Large Language Model Reasoning Without Verbalized Feedback Nearchos Potamitis, Akhil Arora Abstract Recent advancements in large language models (LLMs) have catalyzed the development of general-purpose autonomous agents, demonstrating remarkable performance in complex reasoning tasks across various domains. This surge has spurred the evolution of a plethora of prompt-based reasoning frameworks. A recent focus has been on iterative reasoning strategies that refine outputs through self-evaluation and verbalized feedback. However, these strategies require additional computational complexity to enable models to recognize and correct their mistakes, leading to a significant increase in their cost. In this work, we introduce the concept of “retrials without feedback” , an embarrassingly simple yet powerful mechanism for enhancing reasoning frameworks by allowing LLMs to retry problem-solving attempts upon identifying incorrect answers. Unlike conventional iterative refinement methods, our method does not require explicit self-reflection or verbalized feedback, simplifying the refinement process. Our findings indicate that simpler retrial-based approaches often outperform more sophisticated reasoning frameworks, suggesting that the benefits of complex methods may not always justify their computational costs. By challenging the prevailing assumption that more intricate reasoning strategies inherently lead to better performance, our work offers new insights into how simpler, more efficient approaches can achieve optimal results. So, are retrials all you need? 1 Introduction With strong reasoning and problem-solving abilities, large language models (LLMs) Brown et al. 2020 such as GPT-4 Achiam et al. 2024 ; OpenAI and et al. 2024 , LLaMA Touvron et al. 2023a ; Touvron et al. 2023b ; Grattafiori et al. 2024 , and PaLM Anil et al. 2023 , have sparked a new-found interest in building general-purpose autonomous agents. LLM-based agents have portrayed excellent performance on reasoning Cobbe et al. 2021 and knowledge-intensive tasks West et al. 2009 , often requiring interactions with complex environments, such as playing complex video games Fan et al. 2022 , performing web navigation Yao et al. 2022 , or enabling tool-use Schick et al. 2023 . Naturally, the rise of LLM-based agents has contributed to the prosperity of prompt-based reasoning frameworks Wei et al. 2022 ; Wang et al. 2023 ; Besta et al. 2024 ; Sel et al. 2024 ; Yang et al. 2024 ; Yao et al. 2024 ; Zhou et al. 2024 ; Shinn et al. 2023 ; Yao et al. 2023 ; Potamitis et al. 2024 that further enhance the problem-solving and reasoning abilities of LLMs. Iterative refinement and its challenges. A burgeoning area of research in this field involves the exploration of iterative reasoning strategies that refine and improve responses through self-evaluation. Methods such as Self-Refine Madaan et al. 2023 and Reflexion Shinn et al. 2023 employ explicit verbalized feedback to guide an LLM in correcting its mistakes and refining its outputs. While effective, these approaches add an additional layer of complexity, requiring the model to both recognize its own errors and articulate useful self-correction strategies. Moreover, owing to an incremental increase in the context window size, verbalized feedback monotonically increases the cost for every subsequent iteration of the overall reasoning pipeline, thereby rendering iterative refinement-based methods exorbitantly expensive. For instance, with GPT-4 as the base model, RAFA Liu et al. 2024 , the state-of-the-art refinement strategy, requires a whopping \simeq 600$ on the Game of 24 benchmark task Yao et al. 2024 comprising just 100 examples in the test set. Present work. In this paper, we introduce the concept of “retrials without feedback” , an embarrassingly simple yet effective mechanism that enhances reasoning frameworks by allowing them to retry a problem-solving attempt whenever an incorrect answer is identified. Unlike Reflexion Shinn et al. 2023 , which relies on explicit self-generated feedback, retrials operate without requiring verbalized introspection: an incorrect answer simply triggers another attempt until the correct solution is found or a predefined computational budget is exhausted. Our results show that under the retrial mechanism, simpler methods such as chain-of-thoughts Wei et al. 2022 often outperform more sophisticated reasoning frameworks such as tree-of-thoughts Yao et al. 2024 or Reflexion Shinn et al. 2023 . This suggests that, when given the opportunity to retry, the added complexity of sophisticated reasoning frameworks and self-reflective approaches may not always justify their computational cost. This raises a fundamental question: Are retrials all you need? By reframing the evaluation of reasoning strategies through the lens of cost efficiency, our work challenges the assumption that more intricate frameworks necessarily lead to better performance and highlights the importance of reconsidering optimization strategies for reasoning with LLMs. 2 Related Work Figure 1: Comparing the cost-quality trade-off of IO, CoT, ToT, and Reflexion using GPT-4o-mini as the base model. Within the indicated budget, simpler methods outperform more complex ones while remaining cost-efficient. In this section, we review works that overlap closely with our study Prompt-based reasoning. Recent research focuses on developing strategies to enhance the reasoning capabilities of LLMs. Few-shot prompting employs demonstrations of high-quality input/output samples to exploit the eagerness of the LLMs to imitate patterns seen in their context window Brown et al. 2020 . Algorithm of thoughts (AoT) Sel et al. 2024 , goes a step further by including algorithmic examples within the prompt to propel the LLM through algorithmic reasoning pathways. Chain-of-Thought (CoT) prompting Nye et al. 2021 ; Wei et al. 2022 ; Kojima et al. 2022 as well as other variants such as Decomposed Prompting Khot et al. 2023 and Least-to-Most Zhou et al. 2023 guide LLMs to decompose a complex question into a sequence of thoughts and then synthesize an answer by resolving them methodically. It has been shown that Self-Consistency (CoT-SC) Wang et al. 2022 can be used to augment such methods by generating multiple thought sequences and then selecting the most accurate answer through majority voting. Recent meta-prompting techniques Suzgun and Kalai 2024 employ a uniform, task-independent prompting framework across multiple tasks, enabling a single LLM to iteratively refine its responses and dynamically adapt to diverse input queries. The Buffer of Thoughts (BoT) Yang et al. 2024 framework extracts task-specific information, uses it to retrieve relevant thought templates from its meta-buffer, and then instantiates them with more task-specific reasoning structures before continuing with the reasoning process. Refinement. Closed-loop approaches that allow an LLM to interact with an external environment can help in choosing and potentially revising an action. Notable examples are ReAct Yao et al. 2023 , REFINER Paul et al. 2023 and Self-Refine Madaan et al. 2023 . Reflexion Shinn et al. 2023 provides further linguistic feedback based on previous attempts while AdaPlanner Sun et al. 2023 also incorporates positive and negative feedback of an individual trajectory. Reason for future, act for now (RAFA) Liu et al. 2024 develops further by planning a trajectory, gathering feedback for the potential planned actions, and then revising the trajectory based on the feedback. Tree search. Thoughts are individual ideas or steps in reasoning, and when connected together, they can be modeled as a tree data structure. Tree search algorithms can then be used to explore a tree of thoughts and optimize the search for a final answer. In “Tree of Thoughts” (ToT), the authors utilize a value function that compares different branches to describe both DFS and BFS flavors of a guided tree-search Yao