Learning What Matters: Pr ioritized C o ncept Learnin g via R elative E rror-driven S ample S election

Shivam Chandhok, Qian Yang, Oscar Mañas, Kanishk Jain, Leonid Sigal, Aishwarya Agrawal · 2025

Read Learning What Matters: Pr ioritized C o ncept Learnin g via R elative E rror-driven S ample S election by Shivam Chandhok, Qian Yang, Oscar Mañas, Kanishk Jain, Leonid Sigal, Aishwarya Agrawal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01085.txt.

Description

Chandhok and co-authors teach vision language models more cheaply by letting the model pick its own next lessons. Instruction tuning works but eats data, labels, and compute. Their 2025 framework, PROGRESS, watches the model's gains across skills as training proceeds and serves up samples from the skills improving fastest, skipping what is mastered or still too hard.

Answers are requested only when needed, and no helper models or heavy gradient math are required for the picking. Across datasets of several sizes, the method beat strong baselines while using far less data and supervision. It also carried across model designs and scaled to larger models. The authors offer it as a practical path to efficient multimodal training.

Catalog record

CREATORShivam Chandhok, Qian Yang, Oscar Mañas, Kanishk Jain, Leonid Sigal, Aishwarya Agrawal
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-01085

Browse the full library · About the Tower of Babel