Learning to Learn from Language Feedback with Social Meta-Learning
Jonathan Cook, Diego Antognini, Martin Klissarov, Claudiu Musat, Edward Grefenstette · 2026
Read Learning to Learn from Language Feedback with Social Meta-Learning by Jonathan Cook, Diego Antognini, Martin Klissarov, Claudiu Musat, Edward Grefenstette (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16488.txt.
Description
Jonathan Cook leads four coauthors on teaching large language models to learn from language feedback. Such models often fail to learn from corrections in conversation and rarely ask for feedback when unsure, leaving dialogues static and one-sided. The authors draw on social meta-learning in humans, or learning how to learn from others, and turn it into a fine-tuning method.
Models train in simulated teaching dialogues, where fixed tasks become interactive social learning problems. The method teaches models to use conversation to solve problems they cannot solve in one turn, and the skill transfers across domains: training on math helps coding, and vice versa. Trained only on fully stated problems, the models still handle vague tasks better, asking for missing facts instead of guessing early. The paper offers a scalable route to systems that learn from language feedback.
Catalog record
| CREATOR | Jonathan Cook, Diego Antognini, Martin Klissarov, Claudiu Musat, Edward Grefenstette |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-16488