From Tokens to Lattices: Emergent Lattice Structures in Language Models

Bo Xiong, Steffen Staab · 2025

Read From Tokens to Lattices: Emergent Lattice Structures in Language Models by Bo Xiong, Steffen Staab (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08778.txt.

Introduction

Bo Xiong and Steffen Staab ask how language models build a lattice of concepts from raw text tokens in 2025. Masked language models learn rich concept knowledge in training. Concepts in them form a web that looks like a lattice. The team uses a math frame that builds concept lattices from object and trait links.

They show the training goal makes the model learn just such a link table in secret. From that table, a concept lattice can be rebuilt by the classic method. Their frame needs no human set concepts. It can find latent concepts past human labels. Three new data sets test the claim. Results back their account of where the lattice comes from.

Catalog record

CREATORBo Xiong, Steffen Staab
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-08778

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Tokens to Lattices: Emergent Lattice Structures in Language Models Bo Xiong, Steffen Staab Abstract Pretrained masked language models (MLMs) have demonstrated an impressive capability to comprehend and encode conceptual knowledge, revealing a lattice structure among concepts. This raises a critical question: how does this conceptualization emerge from MLM pretraining? In this paper, we explore this problem from the perspective of Formal Concept Analysis (FCA), a mathematical framework that derives concept lattices from the observations of object-attribute relationships. We show that the MLM’s objective implicitly learns a formal context that describes objects, attributes, and their dependencies, which enables the reconstruction of a concept lattice through FCA. We propose a novel framework for concept lattice construction from pretrained MLMs and investigate the origin of the inductive biases of MLMs in lattice structure learning. Our framework differs from previous work because it does not rely on human-defined concepts and allows for discovering "latent" concepts that extend beyond human definitions. We create three datasets for evaluation, and the empirical results verify our hypothesis. 1 Introduction Masked language models (MLMs) ( Devlin et al. 2019 ) are pretrained to predict a masked token given its bidirectional context. This self-supervised pretraining enables MLMs to encode vast amounts of human and linguistic knowledge ( AlKhamissi et al. 2022 ; Petroni et al. 2019 ) , making them valuable and implicit knowledge bases for a variety of knowledge-intensive tasks ( Van Aken et al. 2019 ) . A key feature of MLMs is their ability to capture conceptual knowledge ( Wu et al. 2023 ; Peng et al. 2022 ; Lin & Ng 2022 ) , including understanding concepts and their hierarchical relationships, which are essential aspects of human cognition. Despite substantial evidence ( Wu et al. 2023 ; Peng et al. 2022 ; Aspillaga et al. 2021 ; Dalvi et al. 2022 ) supporting MLMs’ ability to conceptualize, the emergence of this capability from their pretraining objectives remains unclear. To interpret this phenomenon, one pitfall of work in this field is the tendency to focus exclusively on human-defined concepts and investigate how MLMs identify and learn these predefined concepts. This is typically achieved by either classifying ( Wu et al. 2023 ; Peng et al. 2022 ) or clustering ( Aspillaga et al. 2021 ; Dalvi et al. 2022 ) terms and then mapping them to established human-defined ontologies, such as WordNet ( Miller 1995 ) . However, this approach often overlooks "latent" concepts that extend beyond human definitions. As a result, while these approaches may illuminate the what —the discovery of human-defined concepts—they do not adequately explain the how —the underlying mechanisms by which conceptualization emerges from the MLMs’ pretraining. In this work, we adopt a mathematical formalization of concepts inspired by philosophical frameworks ( Ganter et al. 2005 ) . In this definition, each concept is defined as the abstraction of a collection of objects that share some common attributes. For example, bird is defined as a set of objects that can fly , have feather , lay eggs , and so on, while eagle is defined as a subset of these objects that share a superset of these attributes. By characterizing concepts as sets of objects and attributes, the partial order relations between concepts are naturally induced from the inclusion relations of the corresponding sets of objects and attributes, which is independent of human-defined structures. Figure 1: A comparison of two hypotheses of conceptualization in language models. (a) Definitional hypothesis assumes that concepts are learned directly from the definitions (i.e., concepts are explicitly defined in the texts); (b) Distributional hypothesis assumes that concepts are learned from the observations of their attributes (i.e., similar concepts have similar attributes). To investigate the question– how does the conceptualization emerge from MLM pretraining? One might argue that MLMs are trained on explicit definitions of concepts (e.g., through handbooks), which we call as the definitional hypothesis . While this hypothesis may seem possible, as argued by ( Cimiano et al. 2005 ) , such grounding or conceptualization is typically not frequently found in non-wikipedia and non-handbook texts or conversation. Moreover, as shown in Fig. 1 (a), the definitional hypothesis relies on human-defined concept names as the text "definition", and cannot handle "latent" concepts whose names are not explicitly defined by human. For example, there is no popularly used term specifying birds that can swim and hunt , but they are indeed a formal concept in the context of FCA. Another interpretation is based on the distributional hypothesis , which assumes that terms are similar to the extent that they share similar linguistic contexts ( Cimiano et al. 2005 ) . Therefore, the distributional hypothesis of formal concepts can be interpreted as: concepts are similar to the extent that they share similar contexts describing their attributes. Fig. 1 shows a comparison of the two hypotheses of concept learning for eagle and owl . Intuitively, the human-defined concept raptor is a rarely used term in texts, while the attributes fly and hunt are more frequently used in texts. In this paper, we follow the distributional hypothesis and argue that the conceptualization of MLMs emerges from the learned dependencies between the latent variables representing the objects and attributes. We made the following contributions: 1) We show that MLMs are implicitly doing Formal Concept Analysis (FCA), a mathematical theory of lattices for deriving a concept lattice from the observations of object and attributes. This is interpreted as: MLMs implicitly model objects or attributes as masked tokens, and model the formal context by the conditional probability between the objects and attributes under certain patterns. As a result, a concept lattice can be approximately recovered from the conditional probability distributions of tokens given some patterns through FCA; 2) we propose a novel and efficient formal context construction method from MLMs using probing and FCA; and 3) we provide theoretical analyses and empirical results on our new datasets that support our findings. Notably, the reconstructed concept lattice contains "latent" concepts that are not defined by human and the evaluation does not require any human-defined concepts and ontologies. Our code and datasets will be made available upon acceptance. 2 Preliminaries Definition 1 (masked language model) . Let w:=[w_{1},\cdots,w_{T}] denote an input sequence of T tokens, each taking a value from a vocabulary V , and w_{\setminus t}:=[w_{1},\cdots,w_{t-1},[\mathrm{MASK}],w_{t+1},\cdots,w_{T}] denote the masked sequence after replacing the t -th token w_{t} with a special [\mathrm{MASK}] token. A masked language model predicts w_{t} using its bidirectional context w_{\setminus t} . Let \mathcal{D} denote the data generating distribution. MLM learns a probabilistic model p_{\theta} that minimizes the pseudo log-likelihood loss \mathrm{PLL}_{\textrm{MLM}}=\mathbb{E}_{w\sim\mathcal{D},t\sim[1,\cdots,T]}-\log p_{\theta}(w_{t}|w_{\setminus t}). (1) MLMs can be interpreted as non-linear version of Gaussian graphical models ( Wang & Cho 2019 ) . The idea is to view tokens as random variables that form a fully-connected undirected graph, i.e., by assuming that each variable is dependent on all the other variables, and learn the dependencies across tokens. The dependencies cross tokens can be identified by conditional mutual information (CMI) ( Anandkumar et al. 2011 ) , defined as the expected pointwise mutual information (PMI) conditioned on the rest of the tokens \displaystyle\mathrm{CMI}_{p_{\theta}}(w_{i};w_{j}|w_{\setminus i,j})=\mathbb{E}_{w_{i},w_{j}}[\log p_{\theta}\left(w_{i}|w_{\setminus i}\left(j,w_{j}\right)\right)-\log\mathbb{E}_{w_{j}|w_{i}}p_{\theta}\left(w_{i}|w_{\setminus i}\left(j,w_{j}\right)\right)], (2) where w(i,w_{j}) denotes the sentence

Read the complete text