Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction
Junhong Shen*, Hao Bai*, Lunjun Zhang, Yifei Zhou, Amrith Setlur, Shengbang Tong, Diego Caples, Nan Jiang, Tong Zhang, Ameet Talwalkar, Aviral Kumar · 2025
Read Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction by Junhong Shen*, Hao Bai*, Lunjun Zhang, Yifei Zhou, Amrith Setlur, Shengbang Tong, Diego Caples, Nan Jiang, Tong Zhang, Ameet Talwalkar, Aviral Kumar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07976.txt.
Description
Junhong Shen and co-authors argue for a new way to make computer agents better in a paper from two thousand twenty-five. Most gains now come from longer chains of thought before acting. But an agent that only thinks cannot learn new facts from the world or change its plan as it goes.
The team proposes scaling the length of contact with the task itself, so one run can include exploring, backtracking, and fresh planning. Simple prompting with longer contact already raised success on web tasks. Their training method then adjusts run length as the agent learns. The trained web agent set a new best among open models on two web benchmarks, and it balanced exploring and settling in a flexible way.
Catalog record
| CREATOR | Junhong Shen*, Hao Bai*, Lunjun Zhang, Yifei Zhou, Amrith Setlur, Shengbang Tong, Diego Caples, Nan Jiang, Tong Zhang, Ameet Talwalkar, Aviral Kumar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-07976