CODE-SHARP: Continuous Open-ended Discovery and Evolution of Skills as Hierarchical Reward Programs

Richard Bornemann, Pierluigi Vito Amadori, Antoine Cully · 2026

Read CODE-SHARP: Continuous Open-ended Discovery and Evolution of Skills as Hierarchical Reward Programs by Richard Bornemann, Pierluigi Vito Amadori, Antoine Cully (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-10085.txt.

Description

General intelligence should expand its own skill set, yet most agent frameworks lean heavily on human engineering. A 2026 paper led by Richard Bornemann, with two co-authors, introduces CODE-SHARP, a framework that grows an archive of Python programs encoding skills. It trains a generalist agent from scratch by reinforcement learning, directly from source code. Each skill program carries a local success condition plus prerequisites delegated to earlier skills.

At runtime, skills route the agent through prerequisite chains, rewarding each completion, so the agent learns only the marginal behavior each new skill adds. On two game benchmarks, autonomous agents beat prior work sixfold and about two and a half times in median performance, uniquely crafting iron tools and mining diamonds. Extended runs discovered over ninety skills and solved long-horizon tasks zero-shot.

Catalog record

CREATORRichard Bornemann, Pierluigi Vito Amadori, Antoine Cully
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE158 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-10085

Browse the full library · About the Tower of Babel