Generating Auxiliary Tasks with Reinforcement Learning

Judah GoldfederDepartment of Computer ScienceColumbia University [email protected], Matthew SoDepartment of Computer ScienceColumbia University [email protected] Hod LipsonDepartment of Mechanical EngineeringColumbia University [email protected] · 2025

Read Generating Auxiliary Tasks with Reinforcement Learning by Judah GoldfederDepartment of Computer ScienceColumbia University [email protected], Matthew SoDepartment of Computer ScienceColumbia University [email protected] Hod LipsonDepartment of Mechanical EngineeringColumbia University [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22940.txt.

Description

Judah Goldfeder, Matthew So, and Hod Lipson study how extra practice tasks can help a model learn its main task better. Such helper tasks often boost results in vision and language, but people must design them by hand. That design work costs time and needs expert skill.

Their method, RL-AUX, uses reinforcement learning to assign helper labels to each training example. The agent earns a reward when its choices improve scores on the main task. Tests on CIFAR-100 grouped into twenty classes show the learned helpers can lift performance without the heavy two-level training used before.

Catalog record

CREATORJudah GoldfederDepartment of Computer ScienceColumbia University [email protected], Matthew SoDepartment of Computer ScienceColumbia University [email protected] Hod LipsonDepartment of Mechanical EngineeringColumbia University [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-22940

Browse the full library · About the Tower of Babel