Scaling In-Context Online Learning Capability of LLMs via Cross-Episode Meta-RL

Xiaofeng Lin, Sirou Zhu, Yilei Chen, Mingyu Chen, Hejian Sang, Ioannis Paschalidis, Zhipeng Wang, Aldo Pacchiano, Xuezhou Zhang, [0.5em] Boston University, Boston, MA · 2026

Read Scaling In-Context Online Learning Capability of LLMs via Cross-Episode Meta-RL by Xiaofeng Lin, Sirou Zhu, Yilei Chen, Mingyu Chen, Hejian Sang, Ioannis Paschalidis, Zhipeng Wang, Aldo Pacchiano, Xuezhou Zhang, [0.5em] Boston University, Boston, MA (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04089.txt.

Description

Learning by doing, inside the conversation, is what Xiaofeng Lin and 8 co-authors train language models to do. Many real tasks reveal information only through interaction, with delayed feedback and a tension between exploring and exploiting. Their 2026 framework, ORBIT, meta-trains models across many episodes using reinforcement learning.

After training, a mid-sized open model learned in context on entirely unseen environments. It matched a far larger frontier model's performance and beat standard fine-tuning. The gains came without any weight updates at test time. Reliable in-context online learning would let deployed agents improve from experience alone, between retrainings.

Catalog record

CREATORXiaofeng Lin, Sirou Zhu, Yilei Chen, Mingyu Chen, Hejian Sang, Ioannis Paschalidis, Zhipeng Wang, Aldo Pacchiano, Xuezhou Zhang, [0.5em] Boston University, Boston, MA
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04089

Browse the full library · About the Tower of Babel