Finding Meaning in Embeddings: Concept Separation Curves

2026

Read Finding Meaning in Embeddings: Concept Separation Curves (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21555.txt.

Introduction

Paul Keuren, Marc Ponsen, and Robert Ayoub Bagheri propose Concept Separation Curves, a classifier-free way to evaluate embeddings. Most tests rely on classifiers or downstream tasks, leaving unclear whether good results come from embedding or classifier. Their approach adds syntactic noise and negations to sentences, then gauges effects on the embeddings. Plotting effects as Concept Separation Curves shows how a model splits conceptual from surface variations. Tests across domains, in Dutch and English, and lengths show the curves offer a reproducible way to judge conceptual stability across models.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33942
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21555

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Finding Meaning in Embeddings: Concept Separation Curves Abstract Sentence embedding techniques aim to encode key concepts of a sentence’s meaning in a vector space. However, the majority of evaluation approaches for sentence embedding quality rely on the use of additional classifiers or downstream tasks. These additional components make it unclear whether good results stem from the embedding itself or from the classifier’s behaviour. In this paper, we propose a novel method for evaluating the effectiveness of sentence embedding methods in capturing sentence-level concepts. Our approach is classifier-independent, allowing for an objective assessment of the model’s performance. The approach adopted in this study involves the systematic introduction of syntactic noise and semantic negations into sentences, with the subsequent quantification of their relative effects on the resulting embeddings. The visualisation of these effects is facilitated by Concept Separation Curves, which show the model’s capacity to differentiate between conceptual and surface-level variations. By leveraging data from multiple domains, employing both Dutch and English languages, and examining sentence lengths, this study offers a compelling demonstration that Concept Separation Curves provide an interpretable, reproducible, and cross-model approach for evaluating the conceptual stability of sentence embeddings. The code is open source and located on github , and a live interactive demo is available at streamlit . Keywords: sentence embedding, embedding evaluation, conceptual representation, concept separation curves, large language models Finding Meaning in Embeddings: Concept Separation Curves Paul Keuren {}^{\ast}{}^{\dagger} , Marc Ponsen † , Robert A. Bagheri ∗ ∗ Utrecht University † Statistics Netherlands [email protected] Abstract content 1. Introduction How can we be certain that a Large Language Model (LLM) is capable of distinguishing between concepts? Oftentimes, this is tested by prompting an LLM and inspecting the agreement of the result 14 ; 26 . The problems with this approach are twofold. Firstly, it is reliant on costly human annotations 22 . Secondly, it makes the implicit assumption that correct answers necessarily reflect genuine understanding, even though models may succeed without representing the underlying concepts 1 ; 3 . The annotations become even more difficult when such an answer cannot be evaluated by hand, as is the case with the output from sentence encoders 18 . Figure 1: Concept Separation Curves. This example has been translated from the Dutch sentence "bevelen geven" (giving orders), which originates from the CompetentNL dataset. Initially, a set of perturbations is computed for a given sentence: a) surface-level perturbation, and b) semantic change. Following the process of embedding each sentence, the difference per vector is measured. The application of this process to the entire corpus provides insight into the quality of the embedding, as demonstrated by the overlap between the curves. In this research, we propose a method which resolves the annotation issue and sheds light on the understanding. Our method, summarised in Figure 1 , is applied to different sentence embedding methods. By taking a corpus and performing perturbations, we can derive a measure of concept separability by the embedding method. The perturbations are key, as they are required to embody different concepts. A concept is defined as a thought or idea 20 , and as such, it can be difficult to generate sentences with different concepts automatically. Due to this, we define a set of rules for the perturbation and implement an example in the form of negation. Unlike existing evaluation approaches( 1 ), our method does not rely on annotated datasets or classifiers; instead, it isolates semantic changes (such as negations) from surface-level perturbations (such as added noise). This makes it possible to directly assess how sensitively an embedding represents meaning, independent of external modelling choices. Although we use our approach on data in two languages (Dutch and English), it is designed to generalise across others as well. To make these claims concrete, we make the following contributions: • We introduce Concept Separation Curves (CSCs) , a classifier-independent method for evaluating sentence embeddings by contrasting semantic and surface-level perturbation. • We propose an automated, annotation-free perturbation framework based on controlled alteration. • We define a geometric overlap measure to quantify separation between semantic and non-semantic effects in embedding space. • We analyse embedding behaviour across models, languages, and sentence lengths, identifying failure modes related to token position sensitivity and sentence length. In the rest of the paper, we will delve into related work. Then, we describe our methods, which focus on language analysis instead of expert knowledge. Finally, we discuss the results and implications of our methods. 2. Related work To give a better overview, we split the related work into two groups: perturbations and concept validity . The impact of text manipulation on the resulting embeddings has been a subject of research for some time. One of the most relevant to this paper is the one by Wang et al. 21 . They make a distinction between different types of automated negations of text to train an embedding. As such, it is closely related to both the Mission Impossible Languages by Kallini et al. 12 method and GPT understanding by Liu et al. 15 . All these methods alter input text to train LLMs; the latter two (by Kallini and Liu) focus on GPT, the first focuses on embedding. Our method also has a focus on embeddings, yet we do not train on the generated data. Furthermore, we also insert terms to create noise to compare with the negations. Concept validation of embeddings in NLP has been studied in various contexts, including semantic similarity, interpretability, and alignment with human judgments. One of the studies in this area was conducted by Fang et al. 9 . In this study, they describe how they alter and measure the ESS questionnaire texts. They use a manual approach to generating texts, which ought to be more or less similar, describing the same properties. The difference between similar and dissimilar is then used as the basis for a boxplot. In our research, we do not alter any text manually, nor do we annotate the expected outcome. We base ourselves purely on grammar, thus reducing bias in the generated output. This is not to say that our method has no bias, but its impact is expected to be reduced 8 . 3. Methods To measure whether a language model’s capability of discerning between concepts, we introduce CSCs. CSCs quantify how sensitively an embedding model reacts to semantic variations (meaning changes) compared to non-semantic variations (surface-level perturbations). This allows us to assess whether embeddings preserve conceptual meaning when sentence form changes. The curves visualise the difference between the two types of alteration. Specifically, each sentence is modified through two parallel processes: Fuzzing, which introduces non-semantic variations, and Negation, which introduces semantic variations. In this research, we use the terms Fuzzing and Negation as this makes the distinction between the different alterations easier to tell apart. Our framework is not limited to strict Fuzzing and Negating, nor is the Negation a full opposite of the original sentence. The embeddings of the altered and original sentences are then compared, and when applied across an entire corpus, the resulting distribution patterns form the CSCs. The overview of the process is shown in Figure 2 . Figure 2: Approach setup, square components are algorithmic processes. This setup summarises

Read the complete text