Unlabeled Data Can Provably Enhance In‑Context Learning of Transformers
Renpu Liu, Jing Yang · 2026
Read Unlabeled Data Can Provably Enhance In‑Context Learning of Transformers by Renpu Liu, Jing Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10058.txt.
Description
Renpu Liu and Jing Yang show that free text can boost how models learn in context. A model can learn a task from a few shown cases in its prompt. But marked cases cost time and funds. Few can fit in one prompt. That caps how well the model does.
Raw text with no marks is vast and grows each day. Some of it links to the task at hand. The pair show that such text can help for sure, not just by luck. They give a proof based claim. It says raw text can lift in context grades past the cap set by marked cases.
Catalog record
| CREATOR | Renpu Liu, Jing Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 96 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-10058