Turning Citation Networks Inside Out: Studying Science Using Content-Based Knowledge Graphs from LLM-Derived Taxonomies
Seorin Kim 0009-0001-5086-2704, Vincent Holst 0009-0002-4117-4966, Vincent Ginis 0000-0003-0063-9608 · 2026
Read Turning Citation Networks Inside Out: Studying Science Using Content-Based Knowledge Graphs from LLM-Derived Taxonomies by Seorin Kim 0009-0001-5086-2704, Vincent Holst 0009-0002-4117-4966, Vincent Ginis 0000-0003-0063-9608 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15062.txt.
Introduction
Seorin Kim, Vincent Holst, and Vincent Ginis map science from the inside out. Their 2026 arXiv paper deals with how fields of study are charted. Most maps rest on citations and metadata, the trails papers leave behind them.
But knowledge moves mainly through content, not through those trails. The authors rebuild a field's structure straight from the text. Each paper becomes a small set of clear knowledge components. Those components come from taxonomies drawn by a language model. The sets then link up into a content-based knowledge graph of the field.
Catalog record
| CREATOR | Seorin Kim 0009-0001-5086-2704, Vincent Holst 0009-0002-4117-4966, Vincent Ginis 0000-0003-0063-9608 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-15062
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Turning Citation Networks Inside Out: Studying Science Using Content-Based Knowledge Graphs from LLM-Derived Taxonomies Seorin Kim 0009-0001-5086-2704, Vincent Holst 0009-0002-4117-4966, Vincent Ginis 0000-0003-0063-9608 Abstract Scientific fields are often mapped using citations and metadata, despite knowledge being transmitted primarily through content. We introduce an “inside-out” approach that reconstructs field structure directly from text by representing each paper as a small set of interpretable knowledge components. Using a large language model to induce domain-specific taxonomies and label papers, each publication is encoded as a triplet of measure, data type, and research-question type. These triplets define a knowledge graph with edges weighted by shared papers. Applied to 617 studies on intergenerational wealth mobility, the graph reveals a stable methodological backbone centered on regression-based mobility measures, alongside substantial temporal variation in component recombination. We further utilize normalized betweenness-to-connectivity ratios to identify components and pairings that act as structural bridges disproportionate to their prevalence. This content-derived, taxonomy-driven mapping complements citation-based approaches by exposing the evolving architecture of methods, data, and questions that define a field. 1 1 footnotetext: * Corresponding author: [email protected] K eywords Knowledge Graph \cdot LLM-empowered Knowledge Graph \cdot Citation Networks \cdot Co-occurrence Analysis 1 Teaser Large language models can convert paper content into an interpretable knowledge graph that reveals stable methodological backbones and overlooked bridges in a research field. 2 Introduction The evolution and organization of science are most commonly studied through citation networks, which use reference relations between academic articles as proxies for the flow of scientific knowledge. Here, we take a radically different approach. Rather than treating papers as the central units of analysis, we deliberately move away from document-centered representations altogether. We propose a content-based knowledge graph in which scientific structure is reconstructed directly from conceptual categories inferred from the text, without relying on citations or other bibliometric metadata. In this sense, the framework turns the usual science-of-science perspective inside-out : instead of studying science via the relations between papers, we study how the substantive components of research assemble into a coherent field. To operationalize this approach at scale, we leverage recent advances in large language models (LLMs) for taxonomy generation and automatic annotation. Prior work has demonstrated the capacity of LLMs to extract structured information from scientific [ 23 , 21 , 13 ] texts as well as to automate categorization tasks [ 11 , 31 ] . Here, we use LLMs to generate and assign a small number of interpretable categories to each publication. The resulting graph is constructed solely from these categories and their co-occurrences. By restricting the representation to three node types, each paper is effectively mapped to a triplet of conceptual features, yielding a compact yet expressive graph that allows both static and temporal structural analysis. We apply this framework to a highly curated corpus of 617 publications on intergenerational wealth mobility. The corpus includes empirical studies that employ wealth mobility measures as well as theoretical contributions analyzing these measures. Accordingly, the three conceptual dimensions – Measures , Data types , and Research-Question Types – are chosen to reflect core methodological and substantive choices in this literature. We analyze the resulting graph using a set of exploratory structural measures, including node, pair, and triangle counts, as well as degree, strength (weighted degree), and node- and edge-level betweenness. In addition, we examine ratios of betweenness to degree (and to count) to identify components that occupy structurally central positions despite limited overall prevalence. Applying these measures reveals that regression-based measures have formed a persistent methodological backbone of the wealth mobility literature since the 2006-2010 period, appearing among the most frequent pairs and triangles. Moreover, comparing node- and edge-level betweenness ratios shows that structural variability arises primarily in how components are combined (pair-wise dynamics) than in which components dominate (node-wise dynamics). In other words, while popular nodes are persistent over periods, their combinations vary over periods. Through the case study, we show that taking this inside-out approach, namely focusing on the content of the academic articles rather than their citation relations, can recover meaningful signals in a controlled setting. 2.1 Previously Explored Methods Understanding the structure and evolution of scientific knowledge requires analytical tools that can capture the conceptual, methodological, and epistemological configurations that underlie a field. Here, the advent of large bibliometric datasets, built on seminal works on citation indexing [ 7 ] and networks of scientific papers [ 17 ] , has enabled data-driven approaches based, for instance, on citation analysis [ 20 ] and keyword co-occurrences [ 19 ] . However, these techniques rely on the implicit assumption that citations and keywords are reliable proxies for publication content and academic influence [ 12 , 2 ] . This limitation becomes particularly evident when citation-based representations are used to study knowledge recombination and novelty, as in e.g., [ 27 , 29 ] . In [ 6 ] , the authors show that the aforementioned two indicators are largely driven by interdisciplinarity and structural properties of citation networks. This points to a broader difficulty of citation analysis, already emphasized in classic work on the heterogeneous and often rhetorical motives for citing prior work [ 16 , 3 , 4 , 14 ] . Indeed, further studies indicate that many citations misrepresent or only weakly engage with the actual content of the cited work, or are merely incidental mentions [ 9 , 10 , 15 , 28 ] . Taken together, these observations suggest that treating citations as proxies for content risks producing a distorted view of the underlying knowledge space. Keywords co-occurrence analyses similarly aim to identify the knowledge structure of a field, but by linking the keywords of publications, which seem to be associated with the research content more than citations do, and weighting edges by their co-occurrence frequencies [ 19 ] . Accordingly, this approach is commonly used in systematic reviews [ 8 , 33 ] . Despite the fact that keywords provide a semantic representation of publications, the incoherent consistency and quality affect the reliability of the analyses [ 22 ] . More recently, natural language processing techniques such as word embeddings and concept-extraction models have emerged to capture semantic relationships in scientific texts, thereby providing a more content-level representation of research. In particular, leveraging its high-dimensional semantic structure, word embedding approaches have been used to quantify novelty by measuring semantic distances or detecting shifts in conceptual neighborhoods over time [ 1 , 32 , 24 ] . However, this high dimensionality is a limitation of this approach, as it lacks interpretability and therefore, the network structure is not inherently meaningful [ 1 ] . Moreover, it is sensitive to training data and parametrization [ 32 ] , making it difficult to link specific dimensions to epistemic constructs or methodological lineages. Complementing this line of work, the concept-extraction approach by [ 25 , 26 ] identifies concepts directly from full-texts using BabelNet and represents them as a concept co-occurrence knowledge graph, treating concepts as the fundamental units of analysis. This knowledge graph is clustered into overlapping topics and summarized via centrality-based key concepts and key phrases. This framework moves beyond metadata and provides a more interpretable view of research fields as subfields emerge as clusters of meaningfully related concepts. Nevertheless, it relies heavily