Knowledge Graph-Driven Expert-Level

Reasoning for Neuroscience · 2026

Read Knowledge Graph-Driven Expert-Level by Reasoning for Neuroscience (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25183.txt.

Introduction

Jake Stephen and Niraj K. Jha ask whether expert neuroscience reasoning can be grown from a single textbook rather than web-scale data. They distill the book into a knowledge graph, validate it with two language models, and fine-tune a small model only on question-answer pairs and reasoning traces drawn from that graph. Reinforcement signals come from graph paths. The result beats large language models on accuracy with far fewer parameters, suggesting structured knowledge alone can induce deep mechanistic understanding.

Catalog record

CREATORReasoning for Neuroscience
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54209
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25183

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Knowledge Graph-Driven Expert-Level Reasoning for Neuroscience Abstract Knowledge graph (KG) is an abstraction that can be extracted from text corpora and used for in-depth reasoning. Prior work has leveraged KGs to fine-tune language models (LMs), enabling domain-specific superintelligence. In this work, we explore whether KG-driven in-depth reasoning capabilities can emerge in neuroscience using only information contained within a single authoritative textbook. The central hypothesis is that structured knowledge, when distilled into a high-quality KG and converted into KG-grounded question-answer (QA) supervision, is sufficient to produce expert-level reasoning through a fine-tuned LM that surpasses large language models (LLMs) in accuracy, while employing orders of magnitude fewer parameters. We construct a textbook-derived KG via a dual-LLM validation pipeline, expand it with a masked LM trained on the KG topology, generate multi-hop QA items, which include QA pairs and reasoning traces, to fine-tune an LM exclusively on KG-derived supervision, and apply reinforcement learning using path-derived KG signals as implicit reward models. Our results demonstrate that deep, mechanistic neuroscience understanding can be induced in the model without reliance on large, heterogeneous web-scale corpora. The KG-based synthetic neuroscience curriculum that readers can quiz themselves on, and the fine-tuned LM, are available at the following GitHub location: https://kg-bottom-up-superintelligence.github.io/neuro-bench . 1 Introduction Language models (LMs) traditionally utilized for cross-domain generalization in natural language understanding and generation have recently demonstrated remarkable task-specific reasoning capabilities [ 1 , 8 , 23 ] . Much of this progress has been driven by scale and advanced post-training techniques, enabling models to achieve near-expert performance in highly structured verifiable domains, such as mathematics and programming [ 12 , 32 ] . However, this top-down training approach, which relies on predicting the next token across broad, general text corpora, often falls short when acquiring the deep, domain-specific abstractions required for specialized scientific fields like neuroscience [ 11 ] . Achieving domain-specific superintelligence—where an artificial system consistently exceeds the best human experts in a narrow discipline—requires more than surface-level pattern matching; it necessitates a foundational, axiomatic understanding of the domain [ 7 , 9 ] . Acquiring deep expertise requires a bottom-up approach, explicitly learning to stitch simple concepts into more complex, higher-order reasoning paths [ 13 , 18 ] . Knowledge graphs (KGs) provide a natural neurosymbolic scaffold for this abstraction, capturing domain primitives as explicit head-relation-tail triples [ 15 , 25 ] . A sequence of these triples forms a multi-hop KG path, representing a complex, verifiable concept. Unfortunately, traditional methods for extracting reliable KGs from unstructured domain text are notoriously difficult to scale [ 39 ] . Conversely, prompting off-the-shelf generative LLMs to perform this extraction often introduces hallucinations and ontological inconsistencies, rendering the resulting KG unsuitable for high-stakes scientific reasoning [ 3 , 17 ] . Furthermore, teaching a model to perform compositional reasoning over these primitives remains an open challenge. Existing alignment methods, like reinforcement learning from human feedback (RLHF) and direct preference optimization (DPO), optimize models based on final-answer correctness or human preference [ 24 , 26 ] . In specialized domains, this often leads to reward hacking, where the model relies on superficial correlations rather than a robust, step-by-step verifiable process [ 30 ] . To bridge this gap, we must provide models with verifiable, scalable, and grounded supervision that encourages the composition of intermediate axioms, i.e., triples [ 20 ] . To address these challenges, we use an end-to-end pipeline that synthesizes training tasks directly from domain-specific primitives, explicitly enabling the model to acquire and compose these facts for complex multi-hop reasoning. Our methodology operates in two distinct phases: graph distillation and curriculum learning. First, we parse authoritative unstructured texts—specifically focusing on foundational neuroscience via Kandel et al. [ 19 ] —and extract an initial set of relationships using a dual-LLM filtering strategy to form a seed KG. To efficiently scale this graph without introducing generative hallucinations, we use GraphMERT [ 3 ] , an efficient graphical encoder that distills high-quality KGs by jointly learning semantic and syntactic representations. The expanded KG is then passed through a strict re-validation filter to ensure ontological fidelity. In the second phase, we traverse multi-hop paths within the validated KG to systematically generate a curriculum of multiple-choice questions (MCQs) and chain-of-thought (CoT) reasoning traces, ranging from one to five hops in complexity. We initially apply supervised fine-tuning (SFT) on the 1-hop and 2-hop question-answer (QA) items (that include the reasoning traces) to ground the model in the domain’s axiomatic facts. Subsequently, we employ reinforcement learning (RL) on 2-hop paths. Crucially, rather than relying on human preference, we use the underlying KG paths as an implicit, verifiable reward model [ 20 ] . By deriving reward signals directly from KG path traversal, we successfully incentivize the model to learn deep compositional reasoning. Our core contributions are as follows: • We adapt the scalable, encoder-only distillation approach of Belova et al. [ 3 ] to a new scientific domain, extracting a highly reliable neuroscience KG from a single authoritative textbook and validating its fidelity through a dual-LLM consensus filter. • Building on the bottom-up curriculum framework of Dedhia et al. [ 11 ] , we construct a comprehensive neuroscience QA curriculum spanning 1-hop to 5-hop reasoning, grounded entirely in verifiable KG paths. • Extending the KG-path-rewarded RL paradigm of Kansal and Jha [ 20 ] , we demonstrate that a 14B-parameter model further fine-tuned on 2-hop RL generalizes compositional reasoning to 3-to-5-hop queries, surpassing a frontier generalist model within the neuroscience domain. The article is organized as follows. Section 2 provides background material and discusses related work. Section 3 discusses the theoretical framework. Section 4 provides the methodological path from a textbook to in-depth reasoning. Section 5 discusses the experimental setup and Section 6 provides experimental results. Section 7 provides a discussion and limitations. Finally, Section 8 concludes the article. 2 Background and Related Work To contextualize our bottom-up pipeline for in-depth compositional reasoning, we briefly review prior literature across four intersecting domains: language modeling in scientific reasoning, neurosymbolic artificial intelligence, reward modeling in RL, and inference-time scaling. 2.1 Large Language Models in Scientific Domains The scaling of autoregressive transformer architectures has led to profound capabilities in natural language understanding [ 8 , 34 ] . In specialized domains, efforts to build expert systems have largely relied on continual pre-training over scientific corpora, yielding models such as Galactica for general science [ 33 ] and Med-PaLM for healthcare [ 31 ] . While these models exhibit robust semantic retrieval, they frequently falter on tasks requiring rigorous compositional reasoning, often suffering from hallucinations and inverse scaling on multi-hop logical deductions [ 16 ] . Standard top-down pre-training optimizes for distributional matching of text rather than the acquisition of axiomatic truth, limiting their capacity to act as autonomous scientific agents [ 11 ] . 2.2 Neurosymbolic AI and Knowledge Graphs Neurosymbolic AI seeks to combine the flexible pattern recognition of deep neural networks with the rigorous, interpretable logic of symbolic systems [ 15 , 27 ] . KGs are a widely adopted symbolic representation, encoding facts as head-relation-tail triples. Historically, KG representation learning relied on translational distance models like TransE [ 5 ] , graph representation methods [ 42 ] , or graph convolutional

Read the complete text