Inducing Concision in VLMs via Data Curation

2026

Read Inducing Concision in VLMs via Data Curation (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25432.txt.

Description

Long answers cost money: every extra token a vision language model writes is compute someone pays for. The DatologyAI Team argues in 2026 that brevity, not just smaller models, is the missing efficiency lever, and that training data curation can deliver it. Models trained on concise, correct examples learn to answer in fewer tokens. The team applied its curation pipeline to a large public vision language dataset and compared the result against standard training data and open frontier models.

Priced in compute per correct answer, the curated models gained a thirty five fold advantage over the most verbose comparable model while staying within about a point of its accuracy. Against the same data left uncurated, matched length accuracy rose by over seventeen points, growing with model size. Verbose reasoning, by contrast, bought no accuracy at any scale tested.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.25432

Browse the full library · About the Tower of Babel