Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering
William Jurayj, Jeffrey Cheng, Benjamin Van Durme · 2025
Read Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering by William Jurayj, Jeffrey Cheng, Benjamin Van Durme (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13962.txt.
Description
A model that must answer every question will guess wildly on some, which can be worse than silence. William Jurayj, Jeffrey Cheng, and Benjamin Van Durme test whether extra thinking time helps models choose silence wisely in a 2025 paper. They pull confidence scores from the reasoning trace itself.
More compute at test time raised both accuracy and confidence in right answers. That link lets a threshold on confidence sort answers from abstentions. The authors extend scoring to settings where some risk is allowed. They also give a recipe for reporting results under such rules. Picking when to stay silent may matter as much as raw skill.
Catalog record
| CREATOR | William Jurayj, Jeffrey Cheng, Benjamin Van Durme |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-13962