Explainable Forecasting of Scientific Breakthroughs from Concept Network Dynamics
Thomas Maillart, Thibaut Chataing, Ntorina Antoni, David Dosu, Paul Bagourd, Julian Jang-Jaccard, Alain Mermoud · 2026
Read Explainable Forecasting of Scientific Breakthroughs from Concept Network Dynamics by Thomas Maillart, Thibaut Chataing, Ntorina Antoni, David Dosu, Paul Bagourd, Julian Jang-Jaccard, Alain Mermoud (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03864.txt.
Introduction
Maillart and co-authors forecast scientific breakthroughs from how concept networks change. Breakthroughs show up as new or stronger links between research concepts. OpenAlex concept networks supply the evolving map. Fifty-nine semantic and topological features describe each concept pair. A two-stage LightGBM model predicts link formation first. A regression stage then estimates the future weight of the link.
Four technology and biomedical domains validate the approach. ROC-AUC lands between about 0.954 and 0.967 at all horizons, with no re-tuning. Prior models sat near 0.90. Forecasts rest on structural, auditable features, not opaque embeddings. Regression error stays stable from one to five years out. Adamic-Adar similarity and degree-based measures drive most of the accuracy. Two expert-checked cases match specialist expectations on convergence. A three-layer plan turns forecasts into research strategy.
Catalog record
| CREATOR | Thomas Maillart, Thibaut Chataing, Ntorina Antoni, David Dosu, Paul Bagourd, Julian Jang-Jaccard, Alain Mermoud |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.03864
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Explainable Forecasting of Scientific Breakthroughs from Concept Network Dynamics Thomas Maillart, Thibaut Chataing, Ntorina Antoni, David Dosu, Paul Bagourd, Julian Jang-Jaccard, Alain Mermoud Abstract We introduce an explainable machine-learning approach that forecasts the structural precursors of scientific breakthroughs—the emergence and intensification of links between research concepts—by modelling how OpenAlex concept networks evolve over time. Using 59 semantic and topological features, a two-stage LightGBM model jointly predicts the formation and the future weight of concept pairs, adding a regression stage that quantifies expected intensity to prior link-existence forecasts ( 22 ; 19 ). Relative to the state of the art, the approach improves accuracy and explainability at once: comparative validation across four technology and biomedical domains yields ROC–AUC in [ 0.954 , 0.967 ] [0.954,\,0.967] at all horizons without re-tuning, exceeding the ∼ \sim 0.90 of prior models, while every forecast rests on structural, auditable features rather than opaque embeddings. Classification performance is high (AUC ≈ \approx 0.95) and regression remains stable (RMSLE 0.45 → 0.6 0.45\to 0.6 over one to five years). Feature attribution shows that structural factors—particularly Adamic–Adar similarity and degree-based Hadamard measures—consistently drive accuracy, suggesting that breakthrough-relevant recombinations emerge in tightly connected sub-networks. Two expert-anchored cases, quantum annealing and AI-enabled quantum architectures , show the model surfacing technological convergence consistent with expert expectations. We then outline a three-layer decision architecture—detection, expert translation, institutional integration—that turns these forecasts into evidence-based research strategy and policy, anchored in open data and explainable features. † † footnotetext: An earlier version of this work was presented at Global Tech Mining Conference 2026 (submission #71). This is a revised and extended preprint. 1 Introduction Scientific breakthroughs increasingly emerge from combining ideas across rapidly evolving knowledge networks ( 37 ; 36 ). This acceleration, amplified by open science and distributed collaboration, is reshaping how science is practised and governed ( 16 ; 4 ), shifting discovery from isolated insight to machine-augmented, cross-disciplinary interaction ( 39 ; 14 ). These dynamics challenge traditional foresight approaches such as expert panels, Delphi methods, and bibliometric trend analyses, which were originally designed for slower and more predictable innovation landscapes ( 26 ; 28 ). The rapid convergence of new technological innovations makes scenario-based reasoning increasingly insufficient. For example, fields such as quantum computing, AI, biotechnology, and materials science are coming together, while digital infrastructures are becoming deeply embedded in social systems ( 41 ; 23 ). As technological transitions accelerate and is increasingly tied to national competitiveness and sovereignty, governments and industries must adapt their strategies and investments in near real time ( 6 ). This context defines a new frontier for the science of science: explaining why some combinations of ideas lead to breakthroughs while others fade. Quantum computing exemplifies this uncertainty. Progress depends on hardware, algorithms, and co-design, particularly in the Noisy Intermediate-Scale Quantum (NISQ) era, where hybrid quantum–classical architectures and advances in error correction shape long-term viability ( 7 ; 13 ). This makes quantum computing a prototypical domain in which robust and explainable foresight is essential. Earlier studies have shown that evolving concept graphs can anticipate emerging research trajectories ( 22 ; 19 ), with link-existence ROC–AUC already exceeding 0.90. Building on this foundation, our contribution improves on the state of the art along two dimensions at once: accuracy , raising link-existence ROC–AUC to [0.954,\,0.967] across three further technology and biomedical domains without re-tuning, and explainability , restricting the model to structural, auditable features so that every prediction and its attribution can be inspected by domain experts—rather than offering a novel forecasting principle, we deliver a more accurate, transparent, and policy-actionable specification of it. We follow the science-of-science literature in distinguishing two complementary definitions of a breakthrough: recombination-based , where a breakthrough is the first meaningful integration of previously disconnected ideas ( 37 ), and impact-based , where a breakthrough is identified ex post by disruptive citation patterns or sustained high impact ( 17 ; 29 ). We forecast the structural precursors captured by the first definition—the appearance and intensification of concept-pair links—which act as observable antecedents of the second. Three design choices distinguish our framework from prior link-prediction work. First, we exploit the OpenAlex curated concept hierarchy : every node is a controlled, semantically traceable concept rather than a learned embedding or raw n-gram, which makes both predictions and feature attributions auditable by domain experts. Second, we add a regression stage on top of link-existence prediction, so the pipeline forecasts not only whether a concept pair will form but how strongly it will be co-cited—a quantity policy actors need to size investments. Third, we forecast on structural, explainable features only (Adamic–Adar, degree Hadamard, weighted Hadamard, etc.), enabling per-edge feature attribution that ports directly into the decision architecture proposed in Section 6 . Predictive performance remains high across horizons ( AUC\approx 0.95 for existence; RMSLE 0.45\to 0.6 at 1\to 5 years for weight), and the same handful of structural features dominates attribution at every horizon. Breakthrough-relevant recombinations therefore do not appear as isolated events but as outcomes of dense, cohesive subnetworks shaped by clustering and selective bridging—a finding consistent across the existence and intensity stages. The remainder of this paper is organized as follows. Section 2 reviews related literature. Section 3 develops a network-based theory of breakthroughs. Section 4 presents the data and forecasting pipeline. Section 5 reports predictive performance and case studies. Section 6 discusses implications for governance and introduces a three-layer decision architecture. Section 7 concludes with perspectives for policy. 2 Related Work Mapping scientific knowledge through citation, co-authorship, and co-occurrence networks has long been central to scientometrics ( 30 ; 8 ; 16 ). Foundational tools such as CiteSpace enabled visualization of structural and temporal shifts in scientific domains, revealing emergent research fronts and disciplinary reconfigurations. Later studies ( 5 ) extended these approaches to examine how national innovation systems and disciplinary clusters evolve through collaboration and citation patterns. Despite their descriptive richness, such methods remain largely retrospective, offering limited capacity to anticipate how new ideas or technologies will emerge. Recent advances in machine learning have shifted scientometrics from mapping to forecasting. Representation learning and graph-based models now capture latent semantic and structural relations among scientific ideas. SPECTER introduced transformer-based embeddings that reveal cross-disciplinary semantic proximity ( 9 ). Building on this foundation, 19 as well as 22 demonstrated that evolving knowledge graphs can predict high-impact research topics before they materialize. Other work ( 24 ; 27 ; 38 ) linked combinatorial novelty to long-term impact, while deep learning and GNN-based approaches expanded predictive capabilities across domains ( 3 ; 40 ). Yet these models often prioritize accuracy over explainability. Conceptually, the science-of-science literature offers two complementary operationalizations of a scientific breakthrough. Impact-based definitions identify breakthroughs ex post through citation dynamics or disruption-style indicators ( 17 ; 29 ). Recombination-based definitions identify breakthroughs as the integration of previously disconnected ideas ( 37 ; 15 ), making them observable in concept or knowledge graphs before any citation signal accrues. The two views are not in conflict: recombination events are structural antecedents, of which only a subset later acquires breakthrough-level impact. Our framework targets the antecedent layer—where actionable foresight has the most lead time—while remaining compatible with downstream impact validation through bibliographic indicators that