H Y P E R N Y M M E R C U R Y : Token Opti m ization through S e mantic Field Const r iction and Re c onstr u ction from Hype r n y ms. A New Text Compression Method
Chris Forrester ∗ \ast and Octavia Sulea ∞ \infty · 2025
Read H Y P E R N Y M M E R C U R Y : Token Opti m ization through S e mantic Field Const r iction and Re c onstr u ction from Hype r n y ms. A New Text Compression Method by Chris Forrester ∗ \ast and Octavia Sulea ∞ \infty (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08058.txt.
Description
Chris Forrester and Octavia Sulea present Hypernym Mercury, a text compression method aimed at cutting the token count of language model prompts, in a 2025 white paper. The scheme rewrites words using hypernyms, which are broader terms that cover a narrower word's meaning. By shrinking each word's semantic field and rebuilding the text later, the authors aim to cut tokens by over 90 percent.
The authors report that the compression can stay lossless and that the level of detail can be tuned. They tested it on open data, including Bram Stoker's Dracula from Project Gutenberg, at the paragraph level across genres and models. The paper's results suggest the savings hold up beyond a single text or system.
Catalog record
| CREATOR | Chris Forrester ∗ \ast and Octavia Sulea ∞ \infty |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08058