Inducing Concision in VLMs via Data Curation
2026
Read Inducing Concision in VLMs via Data Curation (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25432.txt.
Description
Long answers cost money: every extra token a vision language model writes is compute someone pays for. The DatologyAI Team argues in 2026 that brevity, not just smaller models, is the missing efficiency lever, and that training data curation can deliver it. Models trained on concise, correct examples learn to answer in fewer tokens. The team applied its curation pipeline to a large public vision language dataset and compared the result against standard training data and open frontier models.
Priced in compute per correct answer, the curated models gained a thirty five fold advantage over the most verbose comparable model while staying within about a point of its accuracy. Against the same data left uncurated, matched length accuracy rose by over seventeen points, growing with model size. Verbose reasoning, by contrast, bought no accuracy at any scale tested.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.25432