Finer is Better (with the Right Scaling)
Clemens Schaefer, Gil Tabak · 2026
Read Finer is Better (with the Right Scaling) by Clemens Schaefer, Gil Tabak (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08565.txt.
Description
Clemens Schaefer and Gil Tabak investigate a puzzle in shrinking language models to very low precision number formats. Smaller blocks should cut error, yet a recent report showed quality getting worse as blocks shrink under a common scaling rule. The authors trace the fault to values clustering near their block peak, which clashes with coarse scaling numbers that can sink to zero.
Stopping that sink to zero helps, and a flexible scale choice method called four over six resolves much of the puzzle. A brute force search confirms error truly falls with finer blocks when scales are chosen well. Chip and software designers learn that format and scaling must be planned together.
Catalog record
| CREATOR | Clemens Schaefer, Gil Tabak |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08565