Distilling Reasoning Without Knowledge: A Framework for Reliable LLMs
Auksarapak Kietkajornrit, Jad Tarifi, Nima Asgharbeygi · 2026
Read Distilling Reasoning Without Knowledge: A Framework for Reliable LLMs by Auksarapak Kietkajornrit, Jad Tarifi, Nima Asgharbeygi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14458.txt.
Introduction
Kietkajornrit, Tarifi and Asgharbeygi split planning from fact lookup to make language models more reliable. Fact questions fail when answers need fresh or disputed information. Search tools cut errors, but vague plans waste tool calls. Their design trains a small student planner with a teacher model. The planner outputs ordered reasoning steps plus fact requests, with no answers shown. Separate modules then search and write the reply. On the SEAL-0 test set, the authors report gains in both accuracy and speed.
Catalog record
| CREATOR | Auksarapak Kietkajornrit, Jad Tarifi, Nima Asgharbeygi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41472 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.14458
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Distilling Reasoning Without Knowledge: A Framework for Reliable LLMs Auksarapak Kietkajornrit, Jad Tarifi, Nima Asgharbeygi Abstract Fact-seeking question answering with large language models (LLMs) remains unreliable when answers depend on up-to-date or conflicting information. Although retrieval-augmented and tool-using LLMs reduce hallucinations, they often rely on implicit planning, leading to inefficient tool usage. We propose a modular framework that explicitly separates planning from factual retrieval and answer synthesis. A lightweight student planner is trained via a teacher-student framework to generate structured decompositions consisting of abstract reasoning steps and searchable fact requests. The supervision signals contain only planning traces and fact requests, without providing factual answers or retrieved evidence. At inference, the planner produces plans, while prompt-engineered modules perform retrieval and response synthesis. We evaluate the proposed framework on SEAL-0 , an extremely challenging benchmark for search-augmented LLMs. Results show that supervised planning improves both accuracy and latency compared to monolithic reasoning models and prompt-based tool-augmented frameworks, demonstrating that explicitly learned planning structures are essential for reliable fact-seeking LLMs. 1 Introduction Large language models (LLMs) have achieved remarkable performance across reasoning, language understanding, and decision-making tasks ( 3 ) . Despite these advances, they remain prone to hallucinations : confident responses that are factually incorrect, unverifiable, or unsupported by available evidence ( 10 ) . Such failures commonly occur when required information is missing, outdated, or lies outside the model’s parametric knowledge, posing a serious challenge for deploying LLMs in real-world question answering and agentic systems where factual reliability is essential ( 27 ) . At a high level, hallucinations arise when models generate plausible-sounding content to fill gaps in missing or uncertain information instead of explicitly acknowledging uncertainty or requesting external evidence ( 12 ) . This behavior is reinforced by training objectives that favor coherent, helpful, and complete answers, even when the necessary facts are unavailable ( 8 ) . Architecturally, most LLMs combine reasoning and factual recall within a single inference process ( 11 ) . Given a user query, the model must simultaneously decide what information is needed, retrieve it from internal parametric memory, and reason over it to produce an answer ( 15 ) . When internal knowledge is incomplete or incorrect, the model has no explicit mechanism to detect this gap, often resulting in hallucinated facts rather than an explicit request for external information ( 2 ) . This issue is particularly severe for up-to-date, verifiable, or long-tail knowledge, where reliance on memorized training data alone is insufficient ( 1 ) . Recent work on retrieval-augmented generation (RAG) and tool-using LLMs has demonstrated that grounding outputs in external sources, such as web search engines, databases, or application programming interfaces (APIs), can substantially improve factual accuracy ( 9 ; 27 ) . Despite this progress, many existing systems still rely on a single LLM to jointly decide what information is needed, how it should be retrieved, and how retrieved content is incorporated during reasoning ( 31 ; 26 ) . This coupling process makes it difficult to attribute errors to specific stages of the pipeline, whether they stem from reasoning, retrieval failures, or incorrect grounding. As LLMs are increasingly deployed in autonomous agentic systems, this entanglement makes failures harder to diagnose, control, and correct. Iteration Loop Start : User Question Student Planner Generate JSON Plan Valid JSON? More Fact Requests? Insert Retrieved Facts Replace placeholders <RESULT_i> with stored facts Source Type? SerpAPI (Google Search) Extractor Extract Answer Compute Module Execute Logic Store Fact Repair Module Fix Syntax Errors Aggregator Synthesize Answer End : Final Output No Yes Yes Web Compute Next Iteration No (Done) Fine-tuned LLM Prompted LLM Figure 1: Inference-time execution pipeline of the proposed framework. In this work, we propose a framework for reliable and hallucination-resistant LLM that explicitly separates reasoning from factual knowledge acquisition, as illustrated in the flowchart in Fig. 1 . Here, reliability refers to the model’s ability to produce factually correct responses grounded in verifiable evidence while avoiding hallucinated claims and refraining from asserting unsupported information ( 16 ) . The key idea is to structure the inference process into distinct stages including planning, information retrieval, factual extraction, and answer aggregation, so that factual claims are grounded in external evidence rather than internal memory. To enable this, we employ a teacher-student training strategy that trains a Student LLM to avoid internalizing factual content. During dataset construction, the Teacher LLM is prompted to decompose each question into (i) a sequence of abstract reasoning steps and (ii) a minimal set of atomic fact requests required to complete those steps. The teacher is explicitly constrained not to answer questions directly or rely on its internal factual knowledge. Instead, it produces structured outputs that describe what needs to be known, rather than what the facts are. The training objective for the Student LLM is to reproduce the teacher’s reasoning structure and information-seeking behavior. The supervision signals contain only planning traces and fact requests, without providing factual answers or retrieved evidence. This design encourages the model to learn planning and retrieval strategies rather than internalizing additional factual content. At inference time, as summarized in Fig. 1 , the student operates independently of the teacher and produces a structured plan consisting of reasoning steps and atomic fact requests. A separate retrieval component executes these requests using external tools. An LLM extractor then converts raw evidence into atomic facts and an LLM aggregator synthesizes the final answer grounded in the retrieved evidence. By shifting factual responsibility to external and verifiable sources, the framework substantially reduces hallucinated content. Moreover, because the student learns structured reasoning rather than factual knowledge, it can be significantly smaller and faster than frontier models, enabling efficient and reliable deployment. We evaluate our framework on SealQA , a challenge benchmark for search-augmented language models that targets fact-seeking questions with noisy, conflicting, or unhelpful web evidence ( 20 ) . In this work, we focus on SEAL-0 , the primary split of SealQA , which consists of difficult questions for which even strong chat models typically achieve near-zero accuracy. Experimental results show that the framework achieves near state-of-the-art performance, outperforming most open-source models while remaining competitive with the strongest reported agentic models. These findings suggest that reasoning-focused distillation, rather than knowledge distillation, provides a promising direction for building more reliable and controllable agentic LLM systems. 2 Reliable LLM Framework We propose a modular framework for reliable and hallucination-resistant language model inference that explicitly separates reasoning from factual knowledge acquisition. The core design principle is to structure the inference process into distinct stages including planning, information retrieval, factual extraction, and answer aggregation, so that factual claims are grounded in external evidence rather than internal parametric memory. A central component of the framework is a teacher-student training strategy used to learn a high-quality planner. Our framework trains a dedicated planner to generate structured reasoning plans and precise information requests, while delegating factual content acquisition entirely to external tools. 2.1 Problem Formulation and Overall Framework Given a natural language question q , the goal is to produce an answer a that is both logically consistent and factually grounded. We assume access to external tools that can return up-to-date, verifiable information. We model inference as a modular pipeline with four