CODE-SHARP: Continuous Open-ended Discovery and Evolution of Skills as Hierarchical Reward Programs
Richard Bornemann, Pierluigi Vito Amadori, Antoine Cully · 2026
Read CODE-SHARP: Continuous Open-ended Discovery and Evolution of Skills as Hierarchical Reward Programs by Richard Bornemann, Pierluigi Vito Amadori, Antoine Cully (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-10085.txt.
Description
General intelligence should expand its own skill set, yet most agent frameworks lean heavily on human engineering. A 2026 paper led by Richard Bornemann, with two co-authors, introduces CODE-SHARP, a framework that grows an archive of Python programs encoding skills. It trains a generalist agent from scratch by reinforcement learning, directly from source code. Each skill program carries a local success condition plus prerequisites delegated to earlier skills.
At runtime, skills route the agent through prerequisite chains, rewarding each completion, so the agent learns only the marginal behavior each new skill adds. On two game benchmarks, autonomous agents beat prior work sixfold and about two and a half times in median performance, uniquely crafting iron tools and mining diamonds. Extended runs discovered over ninety skills and solved long-horizon tasks zero-shot.
Catalog record
| CREATOR | Richard Bornemann, Pierluigi Vito Amadori, Antoine Cully |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 158 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-10085