Learning to Learn from Language Feedback with Social Meta-Learning

Jonathan Cook, Diego Antognini, Martin Klissarov, Claudiu Musat, Edward Grefenstette · 2026

Read Learning to Learn from Language Feedback with Social Meta-Learning by Jonathan Cook, Diego Antognini, Martin Klissarov, Claudiu Musat, Edward Grefenstette (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16488.txt.

Description

Jonathan Cook leads four coauthors on teaching large language models to learn from language feedback. Such models often fail to learn from corrections in conversation and rarely ask for feedback when unsure, leaving dialogues static and one-sided. The authors draw on social meta-learning in humans, or learning how to learn from others, and turn it into a fine-tuning method.

Models train in simulated teaching dialogues, where fixed tasks become interactive social learning problems. The method teaches models to use conversation to solve problems they cannot solve in one turn, and the skill transfers across domains: training on math helps coding, and vice versa. Trained only on fully stated problems, the models still handle vague tasks better, asking for missing facts instead of guessing early. The paper offers a scalable route to systems that learn from language feedback.

Catalog record

CREATORJonathan Cook, Diego Antognini, Martin Klissarov, Claudiu Musat, Edward Grefenstette
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-16488

Browse the full library · About the Tower of Babel