OCC-RAG: Optimal Cognitive Core for Faithful Question Answering
Maksim Savkin, Mikhail Goncharov, Alexander Gambashidze, Alla Chepurova, Dmitrii TarasovNikita Andriianov Daria Pugacheva, Vasily Konovalov, Andrey Galichin, Ivan Oseledets[0.4cm] OCC Team · 2026
Read OCC-RAG: Optimal Cognitive Core for Faithful Question Answering by Maksim Savkin, Mikhail Goncharov, Alexander Gambashidze, Alla Chepurova, Dmitrii TarasovNikita Andriianov Daria Pugacheva, Vasily Konovalov, Andrey Galichin, Ivan Oseledets[0.4cm] OCC Team (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00683.txt.
Introduction
Savkin and co-authors build small language models for faithful answers in this 2026 paper. Their view is that many jobs need sound reasoning more than vast stored facts. Their model family, OCC, is built on that view. One member, OCC-RAG, answers questions from a given text and must stick to that text.
To train it, the team makes over three million practice questions. The set stresses multi-step reasoning, strict faith to the source, and the sense to decline when the text lacks an answer. They release two sizes, with 0.6 and 1.7 billion parameters. Each answer gives a reasoning trace with quotes from the source as proof. The authors report that these small models match or beat general models two to six times their size. Tests cover multi-hop questions, faith checks, and refusal checks.
Catalog record
| CREATOR | Maksim Savkin, Mikhail Goncharov, Alexander Gambashidze, Alla Chepurova, Dmitrii TarasovNikita Andriianov Daria Pugacheva, Vasily Konovalov, Andrey Galichin, Ivan Oseledets[0.4cm] OCC Team |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00683
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OCC-RAG: Optimal Cognitive Core for Faithful Question Answering Maksim Savkin, Mikhail Goncharov, Alexander Gambashidze, Alla Chepurova, Dmitrii TarasovNikita Andriianov Daria Pugacheva, Vasily Konovalov, Andrey Galichin, Ivan Oseledets[0.4cm] OCC Team Abstract Recent progress in the development of language models has been defined by scale, with each generation absorbing more of the world’s knowledge into its weights. However, many practical applications benefit more from robust reasoning than from extensive parametric knowledge. In this setting, task-specialized small language models (SLMs) offer a principled design choice. We introduce Optimal Cognitive Core (OCC), a family of SLMs built around this premise. As a variant of OCC, we present OCC-RAG, optimized for faithful question answering (QA) grounded in the provided context. This task directly aligns with the OCC design approach, requiring multi-hop reasoning over supplied passages while ignoring memorized knowledge. To train OCC-RAG, we implement a novel pipeline for synthesizing multi-context, multi-hop QA data at scale, producing a corpus of over three million examples targeting multi-hop reasoning, strict context faithfulness, and calibrated abstention. We release OCC-RAG-0.6B and OCC-RAG-1.7B, both mid-trained on this corpus. The models produce structured reasoning traces with source citations grounded in literal quotes from the context. Through OCC-RAG, we demonstrate that compact, task-specialized SLMs can match or exceed general-purpose models 2 – 6 × \times their size across multi-hop reasoning (HotpotQA, MuSiQue, TAT-QA), faithfulness (ConFiQA), and refusal (MuSiQue-Un) benchmarks. 1 1 footnotetext: ∗ Core contributors. 2 2 footnotetext: † Correspondence to [email protected] . 0 0.6 1 2 4 8 14 27 32 30 40 50 60 70 80 OCC-RAG-0.6B OCC-RAG-1.7B Qwen3-0.6B Qwen3-1.7B Qwen3-4B Qwen3-8B Qwen3-14B Qwen3-32B SmolLM3-3B Gemma3-1B Gemma3-4B Gemma3-12B Gemma3-27B Model size (B) Average score (%) Figure 1: Performance-efficiency trade-off across language models for faithful context QA. OCC-RAG models (0.6B and 1.7B) achieve competitive or superior performance on multi-hop reasoning, faithfulness, and refusal benchmarks compared to general-purpose models 2-6\times their size, demonstrating that a compact, task-specialized architecture can outperform larger models when explicitly trained for context grounding and evidence-based reasoning. 1 Introduction Frontier language models grow larger and absorb ever more of the world’s knowledge, yet many practical applications benefit more from compact, task-specialized architectures ( 3 ) . Small Language Models (SLMs) have demonstrated competitive or superior performance across commonsense reasoning ( 5 ) , mathematical reasoning ( 18 ) , tool calling ( 34 ) , and retrieval-augmented generation ( 25 ) . Furthermore, fine-tuning SLMs on targeted datasets enables cost-effective adaptation to specialized use cases, an advantage especially pronounced when computational resources are limited ( 9 ) . One such task is Context Question Answering (Context QA), where models answer questions based exclusively on a provided context, generating responses grounded in or reasoning from that input ( 21 ; 2 ) . A central requirement for such systems is faithfulness: producing outputs strictly derived from the given context while disregarding parametric knowledge. Faithfulness thus measures both the alignment of the answer with the evidence and the absence of hallucinated content ( 20 ; 13 ; 23 ) . Context QA poses a significant challenge, as LLMs have been shown to favor their own parametric knowledge over provided context ( 26 ) . Furthermore, even the most capable models frequently fail to remain faithful across counterfactual, inconsistent, and unanswerable scenarios ( 19 ; 4 ) . In this work, we introduce Optimal Cognitive Core (OCC), our family of SLMs that prioritizes task-specific reasoning capabilities over knowledge capacity. Within the OCC family, we present OCC-RAG 1 1 1 We name our models OCC-RAG to emphasize their specialized optimization for retrieval-augmented generation (RAG) pipelines, even though they embed no explicit retrieval component. This naming follows established conventions in faithful QA systems (e.g., Pleias-RAG ( 14 ) ), where the suffix signals the model’s primary deployment context and evaluation setting rather than internal architecture. , designed for faithful Context QA. The model is built around the three capabilities that define a strong context QA system: (1) multi-hop inference and commonsense reasoning , to synthesize information across disparate parts of the context and bridge logical gaps with implicit world knowledge ( 33 ) ; (2) avoidance of memorization , so that pretraining knowledge does not override or interfere with the provided context ( 8 ) (Figure 2 ); and (3) safe abstention , declining to answer when the context is insufficient, ambiguous, or lacks the necessary information to construct a faithful response ( 12 ) . Together, these properties make OCC-RAG a strong context-grounded reasoner that is both computationally practical and operationally trustworthy. We release OCC-RAG-0.6B and OCC-RAG-1.7B, mid-trained from Qwen3-0.6B-Base and Qwen3-1.7B-Base, respectively, on a corpus of over 3M QA synthetic examples produced via our novel data generation pipeline. The corpus targets multi-hop reasoning, strict context faithfulness, and calibrated abstention, spanning multi-context scenarios with distractor passages and unanswerable cases. Following Pleias-RAG ( 14 ) , the models produce structured reasoning traces with source citations grounded in literal quotes from the context. We evaluate OCC-RAG on context QA benchmarks spanning multi-hop reasoning (HotpotQA ( 32 ) , MuSiQue ( 29 ) , TAT-QA ( 36 ) ), context faithfulness (ConFiQA ( 4 ) ), and abstention on unanswerable questions (MuSiQue-Un 29 ). Both OCC-RAG-0.6B and OCC-RAG-1.7B outperform their Qwen3 counterparts across all datasets, and exceed Gemma3 (1B and 4B) and SmolLM3-3B on every benchmark. They further outperform Qwen3 models 2 – 6 \times larger on faithfulness, abstention, and financial reasoning, and substantially improve over the prior context QA-specialized baseline, Pleias-RAG-1.2B. For example, OCC-RAG-0.6B exceeds Qwen3-1.7B ( 2.8\times larger) by 9.5 points on ConFiQA, reduces memorization from 8.2 (Qwen3-0.6B) to 5.2, and surpasses Pleias-RAG-1.2B by 21.6 points on MuSiQue. Through OCC-RAG, we demonstrate that compact, task-specialized SLMs can match or exceed larger general-purpose models. Faithful vs. Truthful vs. Hallucination Context: ‘‘Charles de Gaulle was a French general and statesman who led the Free French Forces. In 2022 Charles de Gaulle was elected the first U.S. president.’’ Question: ‘‘Who is the first president of the U.S.?’’ Model Responses: • OCC-RAG-1.7B: Charles de Gaulle Faithful • Llama-3.3-70B-Instruct: Charles de Gaulle Faithful • Meta-Llama-3-8B-Instruct: George Washington Truthful • Meta-Llama-3.2-1B-Instruct: Donald Trump. Hallucination Figure 2: Faithful, truthful, and hallucinated responses under context–memory conflict. The context contains a counterfactual claim (de Gaulle as the first U.S. president), contradicting real-world knowledge. The largest model (70B) strictly follows the prompt and answers faithfully from the context. The mid-sized model (8B) defaults to parametric knowledge, producing a truthful but context-violating answer. The smallest model (1B) hallucinates an unsupported response. In contrast, OCC-RAG-1.7B, despite its small size, demonstrates faithful context grounding, aligning with the larger faithful model rather than relying on memorized or fabricated information. 2 Model Design Principles OCC-RAG models – our SLM family specifically designed for Context QA should possess the following properties: (1) multi - hop inference and commonsense reasoning for complex questions; (2) avoidance of memorization (faithfulness to context, no conflict with internal knowledge); and (3) safe abstention when the provided context is insufficient. Mid-training serves as a core stage that explicitly shapes the SLM’s reasoning architecture for Context QA, enabling developers to gain fine-grained control over evidence combination and yielding more reliable, interpretable, and context-aligned downstream QA. Large-scale agentic mid-training on synthetic trajectories across math, code, and tool-use further