Cracking the Code of Action: A Generative Approach to Affordances for Reinforcement Learning

Lynn Cherif, Flemming Kondrup, David Venuto, Ankit Anand, Doina Precup, Khimya Khetarpal · 2025

Read Cracking the Code of Action: A Generative Approach to Affordances for Reinforcement Learning by Lynn Cherif, Flemming Kondrup, David Venuto, Ankit Anand, Doina Precup, Khimya Khetarpal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17282.txt.

Description

Lynn Cherif and co-authors teach web agents to act with fewer examples in this 2025 paper. Agents that drive a mouse and keyboard across web pages normally need huge sets of expert demonstrations. In sparse-reward settings, only a few actions fit each moment, so wasted exploration hurts badly.

Their method, CoGA, asks a vision-language model to write small programs that list which actions make sense for a stated intent. An automatic pipeline checks those programs, and the learning agent consults them as it acts. On a broad web-task benchmark, the agent learned orders of magnitude faster. The programs also transferred across related tasks and matched cloning of expert behavior.

Catalog record

CREATORLynn Cherif, Flemming Kondrup, David Venuto, Ankit Anand, Doina Precup, Khimya Khetarpal
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-17282

Browse the full library · About the Tower of Babel