Generating Auxiliary Tasks with Reinforcement Learning
Judah GoldfederDepartment of Computer ScienceColumbia University [email protected], Matthew SoDepartment of Computer ScienceColumbia University [email protected] Hod LipsonDepartment of Mechanical EngineeringColumbia University [email protected] · 2025
Read Generating Auxiliary Tasks with Reinforcement Learning by Judah GoldfederDepartment of Computer ScienceColumbia University [email protected], Matthew SoDepartment of Computer ScienceColumbia University [email protected] Hod LipsonDepartment of Mechanical EngineeringColumbia University [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22940.txt.
Description
Judah Goldfeder, Matthew So, and Hod Lipson study how extra practice tasks can help a model learn its main task better. Such helper tasks often boost results in vision and language, but people must design them by hand. That design work costs time and needs expert skill.
Their method, RL-AUX, uses reinforcement learning to assign helper labels to each training example. The agent earns a reward when its choices improve scores on the main task. Tests on CIFAR-100 grouped into twenty classes show the learned helpers can lift performance without the heavy two-level training used before.
Catalog record
| CREATOR | Judah GoldfederDepartment of Computer ScienceColumbia University [email protected], Matthew SoDepartment of Computer ScienceColumbia University [email protected] Hod LipsonDepartment of Mechanical EngineeringColumbia University [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-22940