Non-Iterative Symbolic-Aided Chain-of-Thought for Logical Reasoning

Phuong Minh Nguyen, Tien Huu Dang, Naoya Inoue · 2025

Read Non-Iterative Symbolic-Aided Chain-of-Thought for Logical Reasoning by Phuong Minh Nguyen, Tien Huu Dang, Naoya Inoue (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12425.txt.

Introduction

Phuong Minh Nguyen, Tien Huu Dang, and Naoya Inoue improve chain-of-thought prompting for logical reasoning by adding light symbolic structure, in work from 2025. Standard chain-of-thought asks a language model to reason in free text steps. Their version weaves symbolic representations into the few-shot examples, giving the steps a consistent, visible strategy.

The method stays non-interactive: the model reasons once, without tools or back-and-forth. Tests covered four benchmarks spanning proof checking, first-order logic, and rule-based puzzles. The symbolic version consistently improved reasoning across model sizes. It beat standard prompting on three of the four datasets, with the largest gains on tasks juggling many constraints. The authors argue the structure makes model reasoning easier to inspect and analyse.

Catalog record

CREATORPhuong Minh Nguyen, Tien Huu Dang, Naoya Inoue
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-12425

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Non-Iterative Symbolic-Aided Chain-of-Thought for Logical Reasoning Phuong Minh Nguyen, Tien Huu Dang, Naoya Inoue Abstract This work introduces Symbolic-Aided Chain-of-Thought (CoT), an improved approach to standard CoT, for logical reasoning in large language models (LLMs). The key idea is to integrate lightweight symbolic representations into few-shot prompts, structuring the inference steps with a consistent strategy to make reasoning patterns more explicit within a non-iterative reasoning process. By incorporating these symbolic structures, our method preserves the generalizability of standard prompting techniques while enhancing the transparency, interpretability, and analyzability of LLM logical reasoning. Extensive experiments on four well-known logical reasoning benchmarks—ProofWriter, FOLIO, ProntoQA, and LogicalDeduction, which cover diverse reasoning scenarios —demonstrate the effectiveness of the proposed approach, particularly in complex reasoning tasks that require navigating multiple constraints or rules. Notably, Symbolic-Aided CoT consistently improves LLMs’ reasoning capabilities across various model sizes and significantly outperforms conventional CoT on three out of four datasets, ProofWriter, ProntoQA, and LogicalDeduction. 1 Introduction In recent years, pre-trained Large Language Models (LLMs) have achieved exceptional success across a wide spectrum of Natural Language Processing (NLP) tasks Wei et al. 2022 ; Shin and Van Durme 2022 ; Dubey et al. 2024 ; Yang et al. 2025 . As a result, LLMs have become a central paradigm in NLP research and applications. Their impressive performance is largely attributed to their ability to perform few-shot in-context learning—the mechanism by which models infer solutions based solely on the format and structure of the input prompt, without requiring gradient computations Brown et al. 2020 ; Garg et al. 2022 ; Wei et al. 2022 . Figure 1: Comparison between standard CoT and Symbolic-Aided CoT for logical reasoning tasks . Notably, as model size increases, prompting techniques that incorporate intermediate reasoning steps consistently outperform standard input–output prompting methods. This reasoning-based prompting strategy is known as Chain-of-Thought prompting (CoT; Wei et al. 2022 ). For in-context learning, the CoT reasoning technique has demonstrated compelling results across a variety of NLP tasks Wei et al. 2022 ; Zhou et al. 2023 . Despite recent advancements, applying LLMs to logical reasoning tasks still faces several critical challenges, including conflicts between pretrained knowledge and counterfactual assumptions ( Ortu et al. 2024 ) , failures on cyclic inference graphs ( Zhang et al. 2025 ) , and planning errors during the solving process Ye et al. 2023 . To address these issues, various strategies have been proposed, which can be broadly categorized into two main groups: (1) designing an external symbolic solver, which delegates the actual reasoning process to an automated theorem prover Ye et al. 2023 ; Pan et al. 2023 or programming languages Gao et al. 2023 ; Xu et al. 2024a ; and (2) constructing a framework that systematically decomposes complex tasks into subtasks—such as rule selection, premise inference, and scoring—to enhance the overall reliability of the system ( Zhang et al. 2025 ; Feng et al. 2024 ; Sun et al. 2024 ; Xu et al. 2024b ) . Although the first approaches potentially achieve remarkable performance, they typically require powerful LLMs Ye et al. 2023 ; Gao et al. 2023 such as GPT-4 Achiam et al. 2023 or additional extensive pre-training phase Xu et al. 2024a ; Feng et al. 2024 for successful parsing from problem description to the logical forms ( e.g., First-order logics - FOL). In this study, we focus on the second approach, which aims to improve LLM logical reasoning without relying on any external symbolic reasoner or programming language . Building on insights from recent works Sun et al. 2024 ; Qi et al. 2025 ; Zhang et al. 2025 , we target the challenge of designing a mechanism to systematically decompose complex logical reasoning tasks into simpler subtasks that can be solved by the inherent understanding ability of LLMs in a single inference pass. Closely related to our work, Xu et al. 2024a ; Feng et al. 2024 recently introduced LLM-based frameworks that leverage first-order logic— a strict formal language with well-defined syntax and semantics—to support faithful logical reasoning. However, these prior studies Sun et al. 2024 ; Xu et al. 2024b ; Zhang et al. 2025 primarily rely on self-refinement or iterative (multi-turn) generation, where each turn solves a sub-task and its output feeds into the next. They overlook non-iterative reasoning. To bridge this gap, we investigate non-iterative (single-turn) reasoning generation , allowing a more direct and fair comparison with CoT prompting. We introduce Symbolic-Aided CoT, a novel variant of CoT Wei et al. 2022 , designed to leverage symbolic representations to enhance the non-iterative logical inference capabilities of LLMs (Figure 1 ). In conventional CoT, intermediate reasoning steps are provided in few-shot demonstrations as unstructured text, enabling LLMs to approximate the logical reasoning process. However, relying solely on textual descriptions for complex reasoning introduces ambiguity, as the inherent vagueness of natural language limits LLMs’ ability to generalize precise reasoning steps. Our core idea is to integrate lightweight symbolic structures into few-shot prompts, making the inference steps more transparent and structured, while simultaneously strengthening the induction-head behavior of LLMs Olsson et al. 2022 . Specifically, our Symbolic-Aided CoT prompting framework explicitly outlines essential reasoning substeps: rule matching —selecting constraint rules that align with the current state of inference, new premise inference —applying the selected rules to generate new premises, and knowledge base (KB) updating —appending the newly inferred premises to the KB set. By incorporating these symbolic structures, our method preserves the flexibility and general applicability of standard prompting techniques while enhancing both the interpretability and analyzability of LLM reasoning behavior. Empirical evaluations across four reasoning QA benchmarks, ProofWriter, FOLIO, ProntoQA, and LogicalDeduction, demonstrate the effectiveness of our approach, particularly in scenarios involving complex reasoning that requires navigating multiple rules and constraints. Remarkably, our Symbolic-Aided CoT, when applied with open-source LLMs ( e.g. , Qwen3), achieves performance comparable to that of a complex multi-turn reasoning framework Sun et al. 2024 built on the powerful GPT-4 model, particularly on the ProofWriter, ProntoQA, and LogicalDeduction datasets. The remainder of this paper is organized into five sections. Section 2 provides an overview of logical reasoning tasks and compares our approach with prior studies. Section 3 presents the details of our proposed framework and its variants. Section 4 describes the experimental setup and reports the results, with key findings discussed in Section 5 . Finally, the conclusions summarize our contributions and outline directions for future work are presented in Section 6 . 2 Background and Related Work 2.1 Background Notation and problem formulation. Logical reasoning is a fundamental NLP task within the Question Answering domain Weston et al. 2015 ; Tafjord et al. 2021 . In this task, machine learning models are required to answer a question based on a context containing multiple logical conditions or constraints. Formally, we denote the list of rules (or constraints) provided in the context as \mathcal{R}=\{r_{i}\}_{0\leq i<N} . Given a question (Q) , the correct answer (A) must be derived from knowledge supported by a subset of rules \mathcal{R}^{*}\subset\mathcal{R} . To address the challenges posed by logical reasoning, prior research largely falls into two overarching directions: utilizing external symbolic solvers and developing LLM-based logical solvers . In the first approach, the main idea is to

Read the complete text