LRAgent: Efficient KV Cache Sharing for Multi-LoRA LLM Agents

Hyesung Jeon, Hyeongju Ha, Jae-Joon Kim · 2026

Read LRAgent: Efficient KV Cache Sharing for Multi-LoRA LLM Agents by Hyesung Jeon, Hyeongju Ha, Jae-Joon Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01053.txt.

Description

Hyesung Jeon and co-authors cut the cost of running many LoRA agents on one base model. Each agent builds its own key-value store for the same long tool runs, wasting memory and time though base weights match. Their LRAgent splits the store in two: a shared base part from the base weights, and a small agent part kept in low-rank form. A new Flash-LoRA-Attention trick rebuilds the agent part on the fly, keeping speed near full sharing and scores near no sharing.

Catalog record

CREATORHyesung Jeon, Hyeongju Ha, Jae-Joon Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68998
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01053

Browse the full library · About the Tower of Babel