Cracking the Code of Action: A Generative Approach to Affordances for Reinforcement Learning
Lynn Cherif, Flemming Kondrup, David Venuto, Ankit Anand, Doina Precup, Khimya Khetarpal · 2025
Read Cracking the Code of Action: A Generative Approach to Affordances for Reinforcement Learning by Lynn Cherif, Flemming Kondrup, David Venuto, Ankit Anand, Doina Precup, Khimya Khetarpal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17282.txt.
Description
Lynn Cherif and co-authors teach web agents to act with fewer examples in this 2025 paper. Agents that drive a mouse and keyboard across web pages normally need huge sets of expert demonstrations. In sparse-reward settings, only a few actions fit each moment, so wasted exploration hurts badly.
Their method, CoGA, asks a vision-language model to write small programs that list which actions make sense for a stated intent. An automatic pipeline checks those programs, and the learning agent consults them as it acts. On a broad web-task benchmark, the agent learned orders of magnitude faster. The programs also transferred across related tasks and matched cloning of expert behavior.
Catalog record
| CREATOR | Lynn Cherif, Flemming Kondrup, David Venuto, Ankit Anand, Doina Precup, Khimya Khetarpal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-17282