The Compressive Knowledge Graph Hypothesis: Which Graph Facts Matter for Scientific Hypothesis Generation?
Shashwat Sourav, Viktoriia Baibakova, Sanjay Das, Ran Elgedawy, Maria Mahbub, Emily Herron, Tirthankar Ghosal · 2026
Read The Compressive Knowledge Graph Hypothesis: Which Graph Facts Matter for Scientific Hypothesis Generation? by Shashwat Sourav, Viktoriia Baibakova, Sanjay Das, Ran Elgedawy, Maria Mahbub, Emily Herron, Tirthankar Ghosal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27176.txt.
Introduction
Sourav and co-authors ask which facts in a knowledge graph actually shape hypotheses about battery materials. They vary graph density, ontology richness, topology, and control structure across three language models, and they score outputs against both the given graph and a fixed reference. Graph context shifts outputs, but models also recover much graph content from prior knowledge alone. Compact top subsets often match full-graph behavior, and even random or topology-based subsets recover much signal, so useful signal is redundant rather than tied to one ranking rule.
Catalog record
| CREATOR | Shashwat Sourav, Viktoriia Baibakova, Sanjay Das, Ran Elgedawy, Maria Mahbub, Emily Herron, Tirthankar Ghosal |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79915 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27176
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Compressive Knowledge Graph Hypothesis: Which Graph Facts Matter for Scientific Hypothesis Generation? Shashwat Sourav, Viktoriia Baibakova, Sanjay Das, Ran Elgedawy, Maria Mahbub, Emily Herron, Tirthankar Ghosal Abstract Knowledge graphs (KGs) can provide structured scientific context to language models, but it remains unclear which graph facts actually shape the generated hypotheses. We study KG-guided hypothesis generation for battery materials across Mistral-7B, Llama-3.1-70B, and Gemini 2.5 Flash. We perturb local KGs by varying density, ontology richness, topology, and control structure, and evaluate outputs with both provided-graph and fixed-reference metrics. Across models, KG utility is selective and model-dependent: graph context changes outputs, but no-KG outputs also recover substantial graph content from model priors. Compact top- k k subgraphs often approximate full-KG behavior, including when claimed-outcome triples are held out. At the same time, compression is not unique to one semantic ranking rule, random and topology-based subsets can also recover much of the signal. These results support a redundancy-aware Compressive KG hypothesis: useful KG signal is often recoverable from compact, scientifically structured subgraphs rather than requiring the full local graph. 1 Introduction Knowledge graphs are increasingly used as a way to give language models structured context ( 26 ; 2 ) . In scientific settings, this is especially appealing ( 33 ; 16 ) . A graph can organize a problem into explicit concepts such as the material system, the failure mode, the proposed intervention, the mechanism, and the target property. In principle, this should help a model move from a vague answer to a more grounded scientific hypothesis ( 3 ) . In practice, however, it is still unclear how much of that graph structure the model actually uses ( 21 ; 10 ) . A model may benefit from a few salient entities, from the relation structure itself, or from only a small subset of the graph while ignoring the rest. If we do not separate these possibilities, it is difficult to know what role external knowledge graphs are really playing in hypothesis generation. Current work often treats knowledge graph prompting as a single intervention: provide the graph, then measure whether performance goes up or down ( 26 ; 32 ) . That view is too coarse for scientific discovery settings. A graph can vary in several ways at once. It can be dense or sparse, coarse or semantically rich, shallow or multi-hop ( 14 ; 25 ) . It can also be partly corrupted, shuffled, or compressed into a targeted subgraph ( 19 ) . When model behavior changes under these conditions, the main question is whether the graph helps, and which part of the graph helps, how that changes across models, and what kind of information remains useful as model capability increases ( 35 ; 34 ) . In this work, we study these questions in a battery-science hypothesis-generation setting. We compare three models with different capability levels: Mistral-7B, Llama-3.1-70B, and Gemini 2.5 Flash ( 13 ; 8 ; 7 ) . For each scientific problem, we generate hypotheses under a family of KG conditions that vary density, ontology richness, topology, and control structure ( 14 ; 25 ; 24 ) . We then evaluate the generated outputs with metrics that separate entity use from relation use, and we add intervention-based analyses that test what information is necessary, sufficient, and causally important ( 6 ) . This lets us move beyond the usual question of whether KG prompting works, and toward a more precise account of how models use external structured knowledge. Our main claim is what we call the Compressive Knowledge Graph Hypothesis. We propose that full-KG behavior is often recoverable from compact subgraphs rather than requiring the entire local graph. This is a redundancy-aware claim, as it does not require one ranking rule to uniquely identify the important triples. Instead, useful signal may be distributed across mechanism, intervention, failure-mode, and outcome-facing relations, and different compact subsets may preserve enough structure to recover similar hypothesis behavior ( 36 ; 23 ) . Across analyses, we find that KG influence is real but model-dependent. Problem identity remains the dominant source of variation, while KG condition has a smaller but measurable effect. Targeted and top- k subgraphs often recover much of the full-KG behavior; fixed-reference scoring shows that this is not merely an artifact of no-KG zeros; and an outcome-held-out control shows that compression is not only claimed-outcome leakage ( 18 ; 20 ) . These findings matter for how knowledge graphs should be used in hypotheses generation. If the useful signal is concentrated in a compact subset, then supplying larger and denser graphs may not be the right design choice, especially for stronger models. A better approach may be to identify the small set of graph facts that actually steers generation. This has consequences not only for knowledge-graph prompting, but also for how we think about retrieval, structured context design, and evaluation in scientific language-model systems ( 9 ; 31 ) . Our contributions are as follows: • We study knowledge-graph-guided hypothesis generation across three models and multiple graph manipulations, including density, ontology, topology, random, shuffled, targeted, and compressed graph conditions. • We introduce an evaluation framework that separates provided-graph use from fixed-reference recovery, allowing no-KG, top- k , random, shuffled, and full-KG outputs to be scored against the same full graph. • We provide evidence for a redundancy-aware Compressive Knowledge Graph Hypothesis : compact subgraphs often recover much of the full-KG behavior, including under an outcome-held-out control, but compression is not unique to a single semantic ranking rule. Figure 1: Overview of the KG-guided generation pipeline. Battery-science fields are converted into a directed KG, verbalized as triples, and provided to language models under different graph conditions. Outputs are evaluated for entity recall, relation fidelity, graph coverage, and semantic distance. 2 Related Work Prior work has studied many ways of combining knowledge graphs with language models, including using KGs as external memory, structured prompts, reasoning scaffolds, or sources of factual grounding. Early knowledge-enhanced language-model work incorporated KG entities, triples, or verbalized KG facts into pretraining and representation learning ( 37 ; 28 ; 1 ) . Surveys on knowledge-enhanced language models and LLM–KG integration argue that KGs can improve factuality, interpretability, and structured reasoning, while LLMs can help construct, complete, and verbalize KGs ( 12 ; 26 ) . Recent GraphRAG work extends this idea by using graph-based indexing, graph-guided retrieval, and graph-enhanced generation to provide relational context for downstream tasks ( 27 ; 11 ) . However, in our work, we are trying to understand which graph facts are actually used during scientific hypothesis generation. Previous works have also developed methods that use KGs to guide hypothesis generation. KG-CoI integrates external structured knowledge into a chain-of-ideas process and uses KG support to reduce hallucinations in hypotheses generation ( 33 ) . Related systems use scientific KGs for link prediction, literature-based discovery, or candidate hypothesis ranking ( 30 ; 29 ; 4 ; 15 ) . These approaches generally treat the KG as useful context or evidence. By contrast, we test the compressive view of KG utility: whether a small subset of high-value triples is sufficient to recover much of the full-KG behavior, whether removing that subset disrupts generation,