Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction

Junhong Shen*, Hao Bai*, Lunjun Zhang, Yifei Zhou, Amrith Setlur, Shengbang Tong, Diego Caples, Nan Jiang, Tong Zhang, Ameet Talwalkar, Aviral Kumar · 2025

Read Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction by Junhong Shen*, Hao Bai*, Lunjun Zhang, Yifei Zhou, Amrith Setlur, Shengbang Tong, Diego Caples, Nan Jiang, Tong Zhang, Ameet Talwalkar, Aviral Kumar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07976.txt.

Description

Junhong Shen and co-authors argue for a new way to make computer agents better in a paper from two thousand twenty-five. Most gains now come from longer chains of thought before acting. But an agent that only thinks cannot learn new facts from the world or change its plan as it goes.

The team proposes scaling the length of contact with the task itself, so one run can include exploring, backtracking, and fresh planning. Simple prompting with longer contact already raised success on web tasks. Their training method then adjusts run length as the agent learns. The trained web agent set a new best among open models on two web benchmarks, and it balanced exploring and settling in a flexible way.

Catalog record

CREATORJunhong Shen*, Hao Bai*, Lunjun Zhang, Yifei Zhou, Amrith Setlur, Shengbang Tong, Diego Caples, Nan Jiang, Tong Zhang, Ameet Talwalkar, Aviral Kumar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-07976

Browse the full library · About the Tower of Babel