Learning Query-Aware Budget-Tier Routing for Runtime Agent Memory
Haozhen Zhang, Haodong Yue, Tao Feng, Quanyu Long, Jianzhu Bao, Bowen Jin, Weizhi Zhang, Xiao Li, Jiaxuan You, Chengwei Qin, Wenya Wang · 2026
Read Learning Query-Aware Budget-Tier Routing for Runtime Agent Memory by Haozhen Zhang, Haodong Yue, Tao Feng, Quanyu Long, Jianzhu Bao, Bowen Jin, Weizhi Zhang, Xiao Li, Jiaxuan You, Chengwei Qin, Wenya Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06025.txt.
Description
Agents built on large language models need memory beyond one context window, but most systems build that memory offline, without knowing the question it must serve. Haozhen Zhang and ten co-authors present BudgetMem, a runtime memory frame that routes each question with its budget in mind. Memory modules come in low, mid, and high tiers, and a small neural router trained with reinforcement learning picks the tier per module.
The team studies three ways to build tiers: method complexity, inference behaviour, and module model size. On LoCoMo, LongMemEval, and HotpotQA, BudgetMem beats strong baselines when performance matters most, and draws better accuracy-cost frontiers when budgets tighten. The analysis shows which tiering axis wins under which regime, giving agent builders a dial, not a guess, for trading memory cost against answer quality.
Catalog record
| CREATOR | Haozhen Zhang, Haodong Yue, Tao Feng, Quanyu Long, Jianzhu Bao, Bowen Jin, Weizhi Zhang, Xiao Li, Jiaxuan You, Chengwei Qin, Wenya Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-06025