Calibrate-Then-Act: Cost-Aware Exploration in LLM Agents

Wenxuan Ding, Nicholas Tomlin, Greg Durrett · 2026

Read Calibrate-Then-Act: Cost-Aware Exploration in LLM Agents by Wenxuan Ding, Nicholas Tomlin, Greg Durrett (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16699.txt.

Description

Wenxuan Ding, Nicholas Tomlin, and Greg Durrett study cost-aware exploration by language model agents. Agents that act in the world must weigh the cost of gathering info against the risk of acting too soon. On a coding task, writing and running a test costs something, but less than running buggy code. The paper shows agents can be led to reason plainly about such cost-uncertainty trade-offs and then act more wisely.

Tasks such as retrieval-augmented question answering and file-reading coding are cast as sequential choices under uncertainty, with hidden environment states shaping success. The Calibrate-Then-Act frame hands the agent an inferred prior about that state, changing behavior in ways standard reinforcement learning training does not teach. Tests on synthetic, question answering, and file-reading tasks show explicit cost-benefit reasoning pays off.

Catalog record

CREATORWenxuan Ding, Nicholas Tomlin, Greg Durrett
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-16699

Browse the full library · About the Tower of Babel