Beyond Cosine Similarity: Taming Semantic Drift and Antonym Intrusion in a 15-Million Node Turkish Synonym Graph

Ebubekir Tosun, Mehmet Emin Buldur, Özay Ezerceli, Mahmoud ElHussieni · 2026

Read Beyond Cosine Similarity: Taming Semantic Drift and Antonym Intrusion in a 15-Million Node Turkish Synonym Graph by Ebubekir Tosun, Mehmet Emin Buldur, Özay Ezerceli, Mahmoud ElHussieni (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13251.txt.

Introduction

Ebubekir Tosun, Mehmet Emin Buldur, Ozay Ezerceli, and Mahmoud ElHussieni tackle a blind spot in word embeddings. Such maps place words by how they act in text. They are poor at one split, though. True kin words and their foes, antonyms, can land close in the map.

Just raising the bar for how close words must be fails to keep foes out. The team built a huge graph of Turkish synonym links to face that flaw head on. The graph holds 15 million nodes. Their cluster method is made to split kin from foes as it groups. For Turkish language tools, the work fills a gap that English first methods left wide open.

Catalog record

CREATOREbubekir Tosun, Mehmet Emin Buldur, Özay Ezerceli, Mahmoud ElHussieni
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-13251

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Cosine Similarity: Taming Semantic Drift and Antonym Intrusion in a 15-Million Node Turkish Synonym Graph Ebubekir Tosun, Mehmet Emin Buldur, Özay Ezerceli, Mahmoud ElHussieni Abstract Neural embeddings have a notorious blind spot: they can’t reliably tell synonyms apart from antonyms. Consequently, increasing similarity thresholds often fails to prevent opposites from being grouped together. We’ve built a large-scale semantic clustering system specifically designed to tackle this problem head-on. Our pipeline chews through 15 million lexical items, evaluates a massive 520 million potential relationships, and ultimately generates 2.9 million high-precision semantic clusters. The system makes three primary contributions. First, we introduce a labeled dataset of 843,000 concept pairs spanning synonymy, antonymy, and co-hyponymy, constructed via Gemini 2.5–Flash LLM augmentation and verified using human-curated dictionary resources. Second, we propose a specialized three-way semantic relation discriminator that achieves 90% macro-F1, enabling robust disambiguation beyond raw embedding similarity. Third, we introduce a novel soft-to-hard clustering algorithm that mitigates semantic drift preventing erroneous transitive chains (e.g., hot → \rightarrow spicy → \rightarrow pain → \rightarrow depression ) while simultaneously resolving polysemy. Our approach employs a topology-aware two-stage expansion–pruning procedure with topological voting, ensuring that each term is assigned to exactly one semantically coherent cluster. The resulting resource enables high-precision semantic search and retrieval-augmented generation, particularly for morphologically rich and low-resource languages where existing synonym databases remain sparse. 1 Introduction The foundational assumption underlying most neural semantic search systems that high cosine similarity between embedding vectors correlates with synonymy is demonstrably false. Embedding models trained on contrastive objectives 41 or word2vec-style objectives 22 optimize for capturing distributional similarity, which conflates multiple semantic relationships into a single continuous measure 11 ; 35 . Antonyms and synonyms alike often occupy proximate regions in embedding space 34 ; 32 ; 33 because they appear in nearly identical linguistic contexts 23 ; 6 , merely differing in implicit negation or opposition. This issue is especially pronounced when synonym databases are built by applying a high similarity cutoff (e.g., cosine similarity \geq 0.85 ), which often admits false positives such as antonyms or broadly related terms. At scale, two factors further aggravate semantic ambiguity in graph clustering. First, modularity-based methods such as Louvain 5 and Leiden 37 impose hard partitions, forcing polysemous words into a single cluster. For example, the Turkish word yüz (“face” / “100”) cannot be represented in multiple senses simultaneously, which either removes valid synonym links or collapses unrelated regions into noisy clusters. Second, semantic drift arises from transitivity: chains of locally plausible links can connect semantically distant concepts (e.g., Sıcak “hot” \rightarrow Acı “spicy” \rightarrow Üzüntü “pain” \rightarrow Depresyon “depression”), and standard clustering methods (e.g., connected components or hierarchical agglomeration) typically cannot distinguish such spurious paths from genuine synonym structure. These difficulties are amplified in morphologically rich, non-English settings. Turkish, in particular, lacks large machine-readable synonym resources comparable to WordNet 25 or BabelNet 29 . Existing resources suffer from two fundamental limitations: (1) they are sparse , containing insufficient coverage of domain-specific terminology (particularly in legal, medical, and technical domains); (2) they are brittle , often created through heuristic rule-based systems or simple distributional similarity thresholds without explicit disambiguation of semantic relationships. The construction of a Turkish synonym resource at scale requires overcoming both antonym intrusion (false positives) and semantic drift (transitivity artifacts). This paper contributes three substantial advances addressing these challenges: A Large-Scale Disambiguated Training Dataset We present a rigorous methodology for generating 843,000 labeled semantic relationship pairs (Synonym, Antonym, Co-hyponym classes) through LLM-augmented synthesis paired with high-confidence dictionary extraction. We generated this dataset using Gemini 2.5-Flash 7 for about $65 which is pretty cost-effective, all things considered. It serves a dual purpose: it’s a novel research contribution in its own right, and it provides the training foundation for our discriminator model. The dataset strikes a balance between synthetic LLM-generated pairs (827,000 instances) and carefully curated dictionary entries (16,000 instances). What’s especially useful here is that we’ve established a reproducible pipeline that anyone can use to generate supervised semantic relationship data for any language as long as you’ve got sufficient terminological resources to work with. A Specialized Multi-Class Discriminator Instead of just tweaking unsupervised similarity thresholds and hoping for the best, we train explicit three-way classifiers that can confidently tell synonyms apart from antonyms and co-hyponyms. Our best model hits 90% F1-macro with confidence scores above 0.98 on clear-cut cases, and we’ve validated that it shows solid cross-model consensus in practice. Think of this discriminator as a strict semantic gatekeeper which it only lets through high-confidence synonym predictions (confidence \geq 0.70 ) while actively filtering out antonyms and those murky low-confidence co-hyponyms. A Novel Disambiguation-Aware Clustering Algorithm We propose a two-stage graph clustering procedure (Expansion followed by Reduction/Pruning) that departs from standard community detection. In the Expansion stage, we apply soft clustering via overlap-based neighbor inclusion, allowing terms to participate in multiple candidate clusters to reflect polysemy. In the Reduction stage, we resolve ambiguity through topological voting, a three-level hierarchical scheme (majority rule, specificity preference, and a deterministic tiebreak) that assigns each term to a single best cluster while preserving recall. The method also mitigates semantic drift by seeding clusters with high-confidence pairs, sorting candidates by confidence, and enforcing intersection-ratio thresholds ( \geq 0.51 ) to prevent weak transitive chains from inflating clusters. At scale, the pipeline processes \sim 15 million unique terms, evaluates 520 million candidate synonym links through successive filters, and yields 2,905,071 final clusters (median size 3, mean 4.58, maximum 86). The resulting synonym graph enforces symmetry and conflict resolution, and it favors standardized domain terminology over noise such as OCR artifacts or informal abbreviations during parent selection. 2 Related Work Distinguishing true synonymy from broader semantic relatedness remains a well-known limitation of distributional semantics 27 ; 24 ; 39 . Building on the distributional hypothesis 18 ; 14 , vector-space models infer meaning from contextual co-occurrence. Although this reliably captures general semantic proximity 2 ; 17 , it also creates systematic ambiguity: words that share contexts are embedded close together even when they stand in relations such as equivalence, opposition, or categorical relatedness 4 . Consequently, antonyms (e.g., hot vs. cold) and co-hyponyms (e.g., cat vs. dog) can appear as similar as genuine synonyms under cosine similarity 31 ; 42 . 26 quantified this effect, showing that standard similarity measures fail to represent relational polarity and can exhibit simultaneous similarity and contrast. Later studies report that the same limitation persists in transformer embeddings, even when trained with large-scale contrastive or retrieval objectives 12 . Thus, despite architectural progress, these models primarily encode distributional overlap rather than semantic equivalence, which makes synonym extraction via simple similarity thresholding unreliable 16 . 2.1 Constraint-Based Approaches to Antonymy One influential line of research sought to address antonym intrusion by modifying embedding spaces using explicit lexical constraints. Counter-fitting 28 introduced a post-training adjustment procedure that pulls known synonyms closer together while pushing antonyms apart. Variants of this approach have shown strong improvements in intrinsic evaluation tasks and downstream lexical inference. However, their effectiveness is tightly coupled to the availability of large, high-quality lexical resources 8 such as WordNet 25 or PPDB 15 . For morphologically rich and comparatively low-resource languages, this dependency presents a serious bottleneck. Turkish,

Read the complete text