Scaling In-Context Online Learning Capability of LLMs via Cross-Episode Meta-RL
Xiaofeng Lin, Sirou Zhu, Yilei Chen, Mingyu Chen, Hejian Sang, Ioannis Paschalidis, Zhipeng Wang, Aldo Pacchiano, Xuezhou Zhang, [0.5em] Boston University, Boston, MA · 2026
Read Scaling In-Context Online Learning Capability of LLMs via Cross-Episode Meta-RL by Xiaofeng Lin, Sirou Zhu, Yilei Chen, Mingyu Chen, Hejian Sang, Ioannis Paschalidis, Zhipeng Wang, Aldo Pacchiano, Xuezhou Zhang, [0.5em] Boston University, Boston, MA (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04089.txt.
Description
Learning by doing, inside the conversation, is what Xiaofeng Lin and 8 co-authors train language models to do. Many real tasks reveal information only through interaction, with delayed feedback and a tension between exploring and exploiting. Their 2026 framework, ORBIT, meta-trains models across many episodes using reinforcement learning.
After training, a mid-sized open model learned in context on entirely unseen environments. It matched a far larger frontier model's performance and beat standard fine-tuning. The gains came without any weight updates at test time. Reliable in-context online learning would let deployed agents improve from experience alone, between retrainings.
Catalog record
| CREATOR | Xiaofeng Lin, Sirou Zhu, Yilei Chen, Mingyu Chen, Hejian Sang, Ioannis Paschalidis, Zhipeng Wang, Aldo Pacchiano, Xuezhou Zhang, [0.5em] Boston University, Boston, MA |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04089