Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering

William Jurayj, Jeffrey Cheng, Benjamin Van Durme · 2025

Read Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering by William Jurayj, Jeffrey Cheng, Benjamin Van Durme (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13962.txt.

Description

A model that must answer every question will guess wildly on some, which can be worse than silence. William Jurayj, Jeffrey Cheng, and Benjamin Van Durme test whether extra thinking time helps models choose silence wisely in a 2025 paper. They pull confidence scores from the reasoning trace itself.

More compute at test time raised both accuracy and confidence in right answers. That link lets a threshold on confidence sort answers from abstentions. The authors extend scoring to settings where some risk is allowed. They also give a recipe for reporting results under such rules. Picking when to stay silent may matter as much as raw skill.

Catalog record

CREATORWilliam Jurayj, Jeffrey Cheng, Benjamin Van Durme
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-13962

Browse the full library · About the Tower of Babel