B-PASTE: Beam-Aware Pattern-Guided Speculative Execution for Resource-Constrained LLM Agents
Yanfei Song · 2026
Read B-PASTE: Beam-Aware Pattern-Guided Speculative Execution for Resource-Constrained LLM Agents by Yanfei Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16469.txt.
Description
Song proposes B-PASTE, a method to cut waiting time for language-model agents that alternate reasoning and tool use. Earlier speculative execution guessed single future tool calls, but B-PASTE guesses bounded branches of future work, ranking them by critical-path savings, not raw likelihood. Only high-value branch starts run on spare resources, with checks for interference, downstream value and state safety. On Thor-class edge hardware, early tests showed up to 1.4 times end-to-end speed, even under tight resource budgets.
Catalog record
| CREATOR | Yanfei Song |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23787 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.16469