Learning What Matters: Pr ioritized C o ncept Learnin g via R elative E rror-driven S ample S election
Shivam Chandhok, Qian Yang, Oscar Mañas, Kanishk Jain, Leonid Sigal, Aishwarya Agrawal · 2025
Read Learning What Matters: Pr ioritized C o ncept Learnin g via R elative E rror-driven S ample S election by Shivam Chandhok, Qian Yang, Oscar Mañas, Kanishk Jain, Leonid Sigal, Aishwarya Agrawal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01085.txt.
Description
Chandhok and co-authors teach vision language models more cheaply by letting the model pick its own next lessons. Instruction tuning works but eats data, labels, and compute. Their 2025 framework, PROGRESS, watches the model's gains across skills as training proceeds and serves up samples from the skills improving fastest, skipping what is mastered or still too hard.
Answers are requested only when needed, and no helper models or heavy gradient math are required for the picking. Across datasets of several sizes, the method beat strong baselines while using far less data and supervision. It also carried across model designs and scaled to larger models. The authors offer it as a practical path to efficient multimodal training.
Catalog record
| CREATOR | Shivam Chandhok, Qian Yang, Oscar Mañas, Kanishk Jain, Leonid Sigal, Aishwarya Agrawal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-01085