A visual observation on the geometry of UMAP projections of the difference vectors of antonym and synonym word pair embeddings

ℝ \mathbb{R} ami Luisto · 2026

Read A visual observation on the geometry of UMAP projections of the difference vectors of antonym and synonym word pair embeddings by ℝ \mathbb{R} ami Luisto (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24150.txt.

Description

Luisto explores the geometry of word embeddings for antonym and synonym pairs. Antonyms are word pairs that share most context traits but differ in one. If models encode concepts as directions, pair difference vectors might reveal that structure. Luisto projects those difference vectors with UMAP and compares antonym pairs with synonym pairs. A curious swirl pattern appears across embedding models in one specific projection setup. The work is presented as a visual, exploratory observation rather than a settled detector.

Catalog record

CREATORℝ \mathbb{R} ami Luisto
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19784
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.24150

Browse the full library · About the Tower of Babel