Logical Reasoning in Large Language Models: A Survey

Hanmeng Liu, Zhizhang Fu, Mengru Ding, Ruoxi Ning, Chaoli Zhang, Xiaozhang Liu, Yue Zhang · 2025

Read Logical Reasoning in Large Language Models: A Survey by Hanmeng Liu, Zhizhang Fu, Mengru Ding, Ruoxi Ning, Chaoli Zhang, Xiaozhang Liu, Yue Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09100.txt.

Introduction

Hanmeng Liu and co-authors survey logical reasoning in large language models, in work from twenty twenty-five. New reasoning models have shown striking skill at hard thought tasks. Whether that skill counts as strict logical reasoning stays open. The survey gathers recent work on logic in these models. It sets out scope, theory roots, and the test sets in use.

Skill is sorted across four reasoning styles: deductive, inductive, abductive, and analogical. Each style gets its own account of strengths and gaps. Ways to lift skill fill a large part of the survey. Data tuning, reward learning, decoding tricks, and hybrid symbolic blends all feature. Gaps that block strict proof-like work are flagged throughout. The close looks ahead to what must improve for trustworthy logic. Readers get a full map of a fast-moving field.

Catalog record

CREATORHanmeng Liu, Zhizhang Fu, Mengru Ding, Ruoxi Ning, Chaoli Zhang, Xiaozhang Liu, Yue Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-09100

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Logical Reasoning in Large Language Models: A Survey Hanmeng Liu, Zhizhang Fu, Mengru Ding, Ruoxi Ning, Chaoli Zhang, Xiaozhang Liu, Yue Zhang Abstract With the emergence of advanced reasoning models like OpenAI o3 and DeepSeek-R1, large language models (LLMs) have demonstrated remarkable reasoning capabilities. However, their ability to perform rigorous logical reasoning remains an open question. This survey synthesizes recent advancements in logical reasoning within LLMs, a critical area of AI research. It outlines the scope of logical reasoning in LLMs, its theoretical foundations, and the benchmarks used to evaluate reasoning proficiency. We analyze existing capabilities across different reasoning paradigms — deductive, inductive, abductive, and analogical — and assess strategies to enhance reasoning performance, including data-centric tuning, reinforcement learning, decoding strategies, and neuro-symbolic approaches. The review concludes with future directions, emphasizing the need for further exploration to strengthen logical reasoning in AI systems. 1 Introduction Logical reasoning is a fundamental challenge to artificial intelligence (AI) and natural language processing (NLP) Newell and Simon (1956) ; McCarthy and Hayes (1981) ; McCarthy (1959) . While early formal logic-based reasoning approaches faced limitations in scalability and adaptability Pereira (1982) ; Cann (1993) , data-driven models became the dominant method since the 1980s McCarthy (1989) . Recently, pre-trained Large Language Models (LLMs) and their emergent logical reasoning abilities have attracted increasing attention Liu et al. (2023b) ; Xu et al. (2023) . Logical reasoning integrates LLMs with inference structuring, enabling multistep deduction and abstraction, and improving interpretability and reliability Shi et al. (2021) ; Stacey et al. (2022) ; Rajaraman et al. (2023) . It also strengthens generalization, helping models handle novel scenarios beyond their training data Haruta et al. (2020) . As LLMs become integral to domains like legal analysis and scientific discovery, ensuring the correctness and verifiability of their reasoning is increasingly vital. As a result, post-training LLM for reasoning has garnered a surge of interest in both industry and research OpenAI (2024) ; DeepSeek-AI (2025) ; Muennighoff et al. (2025) . {forest} Figure 1: The structure of this survey Despite growing research, existing surveys Plaat et al. (2024) ; Sun et al. (2023) ; Yu et al. (2024) often conflate logical reasoning with general-purpose heuristic strategies like Chain-of-Thought (CoT) Xia et al. (2024) . There has been a lack of a literature review dedicated to LLM and formal symbolic logic. This survey provides a comprehensive review of logical reasoning in large language models (LLMs), with a focus on formal and symbolic logic-based reasoning rather than general heuristic approaches. We begin by defining logical reasoning in AI, distinguishing it from general-purpose reasoning, and categorizing key paradigms, including deductive, inductive, abductive, and analogical reasoning. Additionally, we analyze existing benchmarks and evaluation methodologies, identifying gaps in assessing symbolic inference, consistency, and robustness. We further explore state-of-the-art techniques for enhancing logical reasoning, such as instruction fine-tuning, logic-informed pre-training, reinforcement learning, inference-time decoding strategies, and hybrid neuro-symbolic methods. We examine recent advances in neuro-symbolic integration, along with applications of theorem provers, logic solvers, and formal verification frameworks in LLMs. Finally, we highlight open challenges in scalability, reasoning consistency, explainability, and efficiency, proposing future directions for multi-modal reasoning, hybrid architectures, and improved evaluation frameworks. The structure of the subsequent chapters is illustrated in Figure 1 . 2 Logic in Artificial Intelligence Logical reasoning is a cornerstone of artificial intelligence (AI), enabling machines to simulate human thought processes and solve complex problems. At its core, logical reasoning applies structured rules to derive conclusions from premises, providing a rigorous framework for decision-making and inference Sun et al. (2023) . 2.1 History of Logic Reasoning Research Logical reasoning can be traced back to ancient Greece, where Aristotle’s syllogisms laid the foundation for classical logic. During the Middle Ages, scholars refined these theories, and in the 17th century, Leibniz’s universal language and calculus ratiocinator bridged logic with mathematics, foreshadowing modern computational logic. The 19th century saw George Boole’s Boolean algebra, which transformed logic into a mathematical framework, laying the foundation for digital computing. The 20th century ushered in modern logic, with Russell and Whitehead’s Principia Mathematica formalizing complex logical systems. By the mid-century, AI pioneers like John McCarthy leveraged logic for knowledge representation and automated theorem proving, leading to logic programming and knowledge bases. The 1970s introduced non-monotonic logic, enabling AI to handle commonsense reasoning. The 1980s saw logical reasoning integrate with knowledge representation, advancing expert systems for real-world applications. The 1990s saw the rise of knowledge graphs, structuring vast knowledge for complex reasoning tasks. In the 21st century, neuro-symbolic approaches have merged deep learning with logical inference, resulting in tools like DeepLogic Cingillioglu and Russo (2019) and SATNet Wang et al. (2019) . Logical reasoning remains a cornerstone of AI research, evolving from philosophy to modern computing. As AI advances, logical reasoning continues to shape intelligent systems, ensuring structured, interpretable, and robust decision-making. 2.2 Types of Logical Reasoning Logical reasoning can be broadly categorized into four main types, each serving distinct purposes and applications: Deductive Reasoning. This type of reasoning derives specific conclusions from general principles or premises. It operates under the rule that if all premises are true and the reasoning is valid, the conclusion must also be true. For example, given the premises “All apples are red” and “This fruit is an apple” one can deduce that “This fruit is red” Deductive reasoning is fundamental in fields such as mathematics and formal logic, where certainty and rigor are paramount. Inductive Reasoning. Unlike deductive reasoning, inductive reasoning draws general conclusions based on specific observations or evidence. While the conclusions are often considered probable, they are not guaranteed to be true. For instance, observing that all swans seen so far are white might lead to the inductive conclusion that “All swans are white” Inductive reasoning is widely used in scientific discovery and data-driven decision-making, where patterns and trends are inferred from empirical data. Abductive Reasoning. This form of reasoning seeks the most plausible explanation or cause for a set of observations, often in the presence of incomplete information. Abductive reasoning is particularly useful in diagnostic tasks and real-world problem-solving. For example, seeing wet spots on the street might lead one to infer that “It has recently rained” While abductive conclusions are not certain, they provide a practical basis for hypothesis generation and decision-making under uncertainty. Dataset Language Question Type Size Source LogiQA Zh/En Multichoice 15,937 Exam-based ReClor En Multichoice 6,138 Exam-based AR-LSAT En Multichoice 2,064 Exam-based CLUTRR En Question-answering 6,016 Rule-based GSM En Math word problems 19K Exam-based LINGOLY En Question-answering 1,133 Expert-designed ConTRoL En ternary classification 8,325 Exam-based FOLIO En binary classification 1,351 Expert-designed LogicNLI En ternary classification 30K Exam-based ProofWriter En binary classification - Exam-based LogicBench En binary classification 1,270 Rule-based GLoRE Zh/En Miscellaneous 17 tasks Miscellaneous LogiGLUE En Miscellaneous 24 tasks Miscellaneous LogiTorch En Miscellaneous 16 tasks Miscellaneous BIG-Bench En Miscellaneous 7 tasks Miscellaneous Table 1: Main Datasets and Benchmarks of Logical Reasoning Task. Analogical Reasoning. Analogical reasoning involves drawing comparisons between similar situations or domains to make inferences or solve problems. By identifying parallels between different scenarios, this type of reasoning enables creative problem-solving and knowledge transfer. For example, understanding that planets orbit the sun in elliptical paths might lead one to analogically reason that

Read the complete text