COMPOSE: Composing Future Theorems from Citations and Formal Structure
David Busbib, Michael Werman · 2026
Read COMPOSE: Composing Future Theorems from Citations and Formal Structure by David Busbib, Michael Werman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30333.txt.
Introduction
David Busbib and Michael Werman introduce grounded future mathematical generation: generating a plausible future claim for an anchor paper from its citation graph and formal dependency graph. A plausible future claim must follow prior work and respect formal dependencies. They propose COMPOSE, conditioning a language model on citation context and formal theorem structure. They construct a dataset of 108,000 paired graph examples from arXiv and Mathlib, plus a benchmark of 47,000 future papers. Experiments show COMPOSE outperforms baselines on retrieval to real future papers, with the best performance under LLM-judge evaluation.
Catalog record
| CREATOR | David Busbib, Michael Werman |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 91436 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30333
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
COMPOSE: Composing Future Theorems from Citations and Formal Structure David Busbib, Michael Werman Abstract A plausible future mathematical claim must satisfy two constraints: it should follow the direction of prior work and respect the formal dependencies that constrain what can validly follow. Existing approaches typically model only one of these sources, producing claims that are either weakly grounded or insufficiently motivated. We introduce grounded future mathematical generation, where the goal is to generate a plausible future theorem-like claim for an anchor paper using two complementary sources of context: its scientific citation graph and aligned formal theorem dependency graph. To address this setting, we propose COMPOSE, a dual-graph framework that conditions a language model on both scientific citation context and formal theorem structure. To support this setting, we construct a dataset of 108K paired scientific-formal graph examples from arXiv and Mathlib, together with a benchmark of 47K future papers from 2024–2025. Experiments show that COMPOSE outperforms strong baselines on retrieval to real future papers and achieves the best overall performance under LLM-judge evaluation, producing more grounded and mathematically richer outputs. These results show that future mathematical generation benefits from combining scientific context with formal structure. Project page is available at https://david-busbib.github.io/COMPOSE-page/ . 1 Introduction Large language models have shown growing promise in anticipating future scientific contributions from existing knowledge across many domains ( 34 ; 25 ; 39 ) . However, in the mathematical domain, a plausible future result must both extend the research trajectory of prior work ( 21 ; 9 ) but also respect the logical dependencies that determine what can validly follow from existing definitions, lemmas, and theorems ( 46 ; 35 ; 8 ) . Thus, the task is not only to produce fluent mathematical text, but to generate a result that is both scientifically meaningful and logically grounded. This challenge is reflected in two complementary sources of mathematical knowledge: scientific papers, which capture how ideas develop across the literature and indicate which directions are worth pursuing ( 5 ; 6 ; 16 ) , and formal theorem libraries such as Lean’s Mathlib, which encode mathematical results together with explicit dependency structure. Combining the two is non-trivial because the same content appears differently in each source, and because the two sources are organized by fundamentally different relational structures ( 12 ; 47 ; 43 ) . Yet existing approaches tackle only one side: models trained on scientific text alone can identify plausible research directions but may generate claims that are not grounded in formal mathematical dependencies ( 42 ; 31 ; 6 ; 16 ) ; theorem-proving systems ( 37 ; 11 ; 46 ) reason over formal structure but lack the surrounding scientific context needed to anticipate which directions are most promising; and structure-based methods typically model only one of these sources, using either citation structure ( 3 ) or theorem dependencies ( 38 ; 48 ) . As a result, existing work still lacks a method that combines both sources for grounded future mathematical generation. Citation Graph Anchor Paper We show Thm 1.1 crystalline lifts via Lem 1.2 … Cited abs Thm 2.4 p -adic Hodge Cited abs Thm 3.2 Galois deform. Cited abs Lem 5.1 uniformisers Cited abs Prop 2.1 isogenies Cited abs Cor 3.5 modularity Scientific Graph Thm Lem Def Formal Graph Mathlib dependencies alignment Scientific Graph Formal Graph Dual Graph Encoder Scientific Graph Encoder Formal Graph Encoder \oplus LLM Decoder Future Research Claim: “If p=2 then there exists a uniformiser \pi\in K so that \mathrm{KL}(\mu_{p},\sigma)=\mu_{nK} . Every crystalline representation V:G_{k}\to\mathrm{GL}_{T} connects to one of these groups via an isogeny if p_{k} vanishes at least once.” Figure 1 : Top: Data construction. Given an anchor paper and its citation graph ( left ), we build its scientific graph ( center ) where blue nodes represent paper abstracts and orange nodes represent extracted theorems. Each informal theorem is matched to its corresponding Mathlib theorem (dashed arrows), and the matched theorems are then used in order the construct the paper’s formal graph of Lean dependencies ( right ). Bottom: Model architecture. The scientific graph and formal graph are encoded by dedicated GNNs, fused via cross-attention ( \oplus ), and used to condition a math-specialized LLM decoder that generates a future research claim . In this work, we propose COMPOSE , a system for generating plausible future mathematical claims from an anchor paper. This is carried out by jointly modeling scientific context and formal mathematical structure. To represent these two sources, we construct two complementary graphs: (i) a scientific graph built from the anchor paper, selected cited papers, and extracted theorems, and (ii) a formal graph built by aligning those theorems to corresponding formal theorems and their dependency structure. These two graphs are encoded separately and fused into a shared representation that conditions an LLM decoder on both the scientific direction of the papers and the formal structure of the underlying mathematics. Figure 1 provides an overview of the full pipeline. To learn this representation effectively, training proceeds in two stages: we first optimize the graph encoders and fusion module with alignment objectives, and then fine-tune the decoder for graph-conditioned generation. The model then generates a theorem-like mathematical text that represents a plausible contribution in the same research direction, grounded in both the evolution of ideas across papers and the dependency structure of formal mathematics. To evaluate this setting, we construct a benchmark of 108K paired samples from arXiv mathematics using training papers collected from the pre-2023 corpus, together with a test set of 47K papers from late 2024 and 2025. Empirically, COMPOSE achieves the strongest retrieval performance in our main evaluation setting and performs best overall under LLM-judge evaluation, with ablations confirming that both graph sources contribute. We make the following contributions: • We study grounded future mathematical generation, where the goal is to predict plausible future mathematical claims using both scientific citation context and formal theorem dependencies. • We construct a dataset of 108K paired scientific-formal graph samples from arXiv and Mathlib, using an informal-to-informal alignment strategy via FrenzyMath, and establish a benchmark of 47K future papers from 2024-2025 for evaluation. • We propose COMPOSE , a system for grounded future mathematical generation that combines scientific citation context with formal theorem structure to generate plausible future mathematical claims. 2 Related Work Future Scientific Generation. Prior work studies future scientific generation in several ways. One line of work generates future research directions from prior literature using retrieval or iterative retrieval-and-reasoning over related papers ( 5 ; 6 ; 31 ) . Another line of work uses citation structure or temporal supervision for the task ( 39 ; 42 ) . GIANTS ( 16 ) uses citation-based scientific context to guide generation, although it targets future scientific summaries rather than theorem-like claims. Some work also explores structure-aware scientific generation using external graphs or chain-of-ideas frameworks ( 14 ; 45 ) . Across these settings, existing systems rely on textual, citation-based, or structured scientific context, without combining the formal theorem structure that constrains what can validly follow from prior results. Formal Mathematical Reasoning. Formal proof libraries such as Lean’s Mathlib ( 27 ) , Isabelle’s Archive of Formal Proofs ( 30 ) , and Coq-based libraries (