Cognitive Training for Language Models: Towards General Capabilities via Cross-Entropy Games

Clément Hongler 1,2 Franck Gabriel 3,1 Valentin Hartmann 1 Arthur Renard 1 Andrew Emil 1 1 Xent Labs 2 EPFL 3 Université Lyon 1 · 2026

Read Cognitive Training for Language Models: Towards General Capabilities via Cross-Entropy Games by Clément Hongler 1,2 Franck Gabriel 3,1 Valentin Hartmann 1 Arthur Renard 1 Andrew Emil 1 1 Xent Labs 2 EPFL 3 Université Lyon 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22479.txt.

Description

Hongler and co-authors propose a way to grow general skills in language models on purpose. Building such a curriculum by hand is an open problem, so they define a family of tasks called cross-entropy games. The games are meant to be universal in a suitable sense. The authors argue that greedy skill discovery then forces one clear meta-objective, up to a few settings. They call the resulting loop cognitive training. With strong enough models playing and sampling, they claim it could drive skill growth.

Catalog record

CREATORClément Hongler 1,2 Franck Gabriel 3,1 Valentin Hartmann 1 Arthur Renard 1 Andrew Emil 1 1 Xent Labs 2 EPFL 3 Université Lyon 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78474
LICENSEhttp://creativecommons.org/publicdomain/zero/1.0/
RIGHTSCC0
SOURCEarXiv

Source: https://arxiv.org/abs/2603.22479

Browse the full library · About the Tower of Babel