TokBench: Evaluating Your Visual Tokenizer before Visual Generation
2025
Read TokBench: Evaluating Your Visual Tokenizer before Visual Generation (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18142.txt.
Description
Junfeng Wu and seven co-authors wrote a 2025 paper benchmarking the image compressors that sit underneath visual generation models. Tokenizers and autoencoders squeeze images into compact codes that generators then work with. Whatever detail the squeeze loses, no generator can restore, so it caps the quality of everything downstream.
Their benchmark, TokBench, probes reconstruction of the two hardest contents: text and faces. Both are small scale, dense with texture, quick to collapse, and quick for human eyes to judge. The team curated clear text and face images and scored reconstructions with established reading and face recognition tools rather than a vision model. The results expose which tokenizers keep fine print and facial detail, guiding builders to fix the bottleneck before generation.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18142