Do Chatbot LLMs Talk Too Much? The YapBench Benchmark
Vadim Borisov, Michael Gröger, Mina Mikhael, Richard H. Schreiber · 2026
Read Do Chatbot LLMs Talk Too Much? The YapBench Benchmark by Vadim Borisov, Michael Gröger, Mina Mikhael, Richard H. Schreiber (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00624.txt.
Description
Vadim Borisov, Michael Gröger, Mina Mikhael, and Richard Schreiber measure a common annoyance with chatbots: they talk too much. Models such as ChatGPT, Claude, and Gemini often pad simple answers with redundant explanation and boilerplate, raising reading effort and token costs. Training and evaluation habits that reward longer answers are suspected causes.
Their benchmark, YapBench, uses single-turn prompts where a short answer suffices, each paired with a curated minimal answer and a category label. The YapScore counts how many extra characters a model produces beyond that baseline, a measure that works across models regardless of tokenizer. The benchmark gives developers a lightweight way to compare over-generation and to push models toward saying exactly enough.
Catalog record
| CREATOR | Vadim Borisov, Michael Gröger, Mina Mikhael, Richard H. Schreiber |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-00624