Joint Continual Learning of Local Language Models and Cloud Offloading Decisions with Budget Constraints

Evan Chen Wenzhi Fang Shiqiang Wang · 2026

Read Joint Continual Learning of Local Language Models and Cloud Offloading Decisions with Budget Constraints by Evan Chen Wenzhi Fang Shiqiang Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00166.txt.

Description

Evan Chen and coauthors propose DA-GRPO, a method for joint continual learning of local small language models and cloud offloading choices under a budget. Local models must serve varied tasks with tight memory and compute, so selective cloud help is unavoidable. Naive reward based learning gives unstable offloading and worsens forgetting as tasks shift. DA-GRPO extends group relative policy optimization with a dual advantage that folds cloud use limits into advantage computation. Tests on math reasoning and code generation show better post switch accuracy.

Catalog record

CREATOREvan Chen Wenzhi Fang Shiqiang Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67427
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00166

Browse the full library · About the Tower of Babel