Word-Centered Semantic Graphs for Interpretable Diachronic Sense Tracking
Imene Kolli, Kai-Robin Lange, Jonas Rieger, Carsten Jentsch · 2026
Read Word-Centered Semantic Graphs for Interpretable Diachronic Sense Tracking by Imene Kolli, Kai-Robin Lange, Jonas Rieger, Carsten Jentsch (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22410.txt.
Introduction
Imene Kolli, Kai-Robin Lange, Jonas Rieger, and Carsten Jentsch track how word senses shift over time with graphs a human can read. Their 2026 preprint builds, for each target word and time slice, a web of nearby senses. Two signals feed the web: word-vector closeness and how well words swap in real text.
The graph form keeps the result open to inspection, unlike black-box scores. Scholars can watch a sense split, fade, or be born across decades of text. The method suits history, media, and language study. It turns a vague drift into a map.
Catalog record
| CREATOR | Imene Kolli, Kai-Robin Lange, Jonas Rieger, Carsten Jentsch |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22410
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Word-Centered Semantic Graphs for Interpretable Diachronic Sense Tracking Imene Kolli, Kai-Robin Lange, Jonas Rieger, Carsten Jentsch Abstract We propose an interpretable, graph-based framework for analyzing semantic shift in diachronic corpora. For each target word and time slice, we induce a word-centered semantic network that integrates distributional similarity from diachronic Skip-gram embeddings with lexical substitutability from time-specific masked language models. We identify sense-related structure by clustering the peripheral graph, align clusters across time via node overlap, and track change through cluster composition and normalized cluster mass. In an application study on a corpus of New York Times Magazine articles (1980–2017), we show that graph connectivity reflects polysemy dynamics and that the induced communities capture contrasting trajectories: event-driven sense replacement ( trump ), semantic stability with cluster over-segmentation effects ( god ), and gradual association shifts tied to digital communication ( post ). Overall, word-centered semantic graphs offer a compact and transparent representation for exploring sense evolution without relying on predefined sense inventories. 1 Introduction Languages evolve with their speaker communities, leading to changes in word meanings over time. One prominent form of language change is semantic shift , where a word’s meaning transforms due to factors such as cultural developments, technological innovations, and contact with other languages ( 28 , p, 1–2) . 1 1 1 A classic example is the English word boy , which originally meant “male servant” in the 14th century and later came to denote “any male child” ( 7 ) . Understanding how such semantic changes occur is central to historical linguistics and cultural studies, and has become increasingly important for language technologies operating on long-spanning textual data ( 30 ) . In semantic linguistics, word meaning refers to the conceptual content conveyed by a word ( 6 ) . A key property of word meaning is polysemy , where a single word expresses multiple senses depending on context. Polysemy plays a crucial role in semantic change, as different senses often coexist for extended periods before one sense becomes dominant, leading to gradual shifts in meaning ( 29 ) . Semantic shift can take several forms, including meaning expansion, contraction, and the emergence of new senses ( 4 ) . Identifying semantic shift requires encoding a word’s senses into a prototypical representation through high-level semantic properties such as the dominant sense and the degree of polysemy, or low-level properties such as the sense distribution ( 22 ) . In this work, we operationalize these properties through graph structure and community evolution: dense cohesive neighborhoods suggest stable meanings, while the emergence of disconnected regions indicates increasing polysemy and sense differentiation. Tracking these changes can reveal the emergence of new meanings, as well as the broadening or narrowing of existing ones ( 22 ) . It also highlights ephemeral changes, where external events temporarily influence usage before a word reverts to earlier meanings ( 26 ) . Recent advances in natural language processing have enabled computational approaches to semantic shift analysis, reducing reliance on time-consuming manual annotation ( 13 ) . Among these, diachronic word embedding methods ( 23 ; 15 ; 14 ; 25 , e.g.,) have become the dominant paradigm, extending both static ( 8 ; 5 , e.g.,) and contextual ( 9 ; 10 , e.g.,) embedding models to temporally ordered corpora. While effective at capturing large-scale semantic trends, both approaches face inherent limitations when representing polysemous words. Static embeddings compress multiple senses into a single vector, making it difficult to disentangle sense-specific change ( 7 ) . Contextual embeddings can represent multiple senses, but typically require aggregation into discrete sense inventories or clusters, introducing challenges related to comparability and interpretability across time ( 22 ) . In this work, we address these limitations by combining static and contextual diachronic word embeddings into a unified graph-based representation. For each target word and time period, we construct a semantic network that integrates global distributional similarity, captured by static embeddings, with context-sensitive lexical substitutability ( 31 ) , captured by contextual embeddings. Concretely, we (i) induce word-centered graphs from static similarity and contextual substitutability, (ii) extract sense communities via peripheral connectivity, and (iii) track sense evolution with overlap-based alignment and normalized community mass. Semantic networks provide an interpretable framework for modeling meaning through relational structure ( 27 ) , and their topological organization has been shown to encode important semantic properties ( 2 ) . Unlike manually curated resources such as WordNet ( 20 ) , the networks we construct are induced directly from corpus evidence and reflect usage-driven semantic organization. By representing a word’s multiple senses as spatial structures within these graphs and tracking their evolution over time, our approach enables graph-based analysis of semantic change that supports sense identification, sense distribution estimation, and temporal shift analysis while maintaining interpretability at both the sense and word levels. 2 Related Work Computational approaches to semantic shift are commonly grouped into form-based and sense-based methods ( 7 ) . Form-based approaches rely on static embeddings, assigning a single vector per word (and per time period), with semantic change approximated via vector drift across aligned spaces. A standard pipeline trains separate embedding models on time-sliced corpora, aligns the resulting spaces, and uses measures such as cosine distance to rank words by change magnitude ( 8 ; 5 , e.g.,) . While effective at capturing shifts in a word’s dominant usage, these methods are inherently limited for polysemous words because they compress multiple senses into one representation ( 7 ) . They are also sensitive to modeling choices, including context window size and the selection of a reference period ( 16 ; 26 ) . 2 2 2 With small windows, embeddings tend to reflect local interchangeability (synonymy/collocation), whereas larger windows can emphasize broader topical/contextual similarity rather than core meaning ( 16 ) . Sense-based approaches aim to explicitly model multiple meanings using contextual embeddings, where each occurrence of a word is represented in context ( 7 ) . To enable diachronic comparison, token representations are typically aggregated into sense-level units via supervised classification or unsupervised clustering ( 9 ; 10 , e.g.,) . While these methods enable finer-grained analysis of sense usage, they introduce challenges related to aggregation, comparability across time, and cluster alignment ( 22 ) . In particular, supervised approaches constrain senses to predefined inventories, while clustering-based methods face sensitivity to cluster number, frequency effects, and the conflation of usage similarity with semantic relatedness ( 22 ; 12 ) . More recently, semantic change has been studied through relational representations, using graphs to model meaning via structured connections rather than isolated vectors or fixed sense inventories. 18 construct semantic trees by clustering contextual embeddings into a predefined set of sense centroids and tracking these structures over time. While this enables a relational view of meaning, it fixes sense granularity a priori and relies solely on contextual similarity, limiting its ability to capture emergent or transient senses. In contrast, our approach induces word-centered semantic graphs directly from corpus evidence by integrating static and contextual signals, allowing sense structure and semantic change to emerge dynamically over time. Beyond representation, prior work has also proposed various metrics for quantifying semantic change, including divergence between sense distributions ( 24 ) ,