Optimal Budgeted Adaptation of Large Language Models

Jing Wang, Jie Shen, Dean Foster, Zohar Karnin, Jeremy C Weiss · 2026

Read Optimal Budgeted Adaptation of Large Language Models by Jing Wang, Jie Shen, Dean Foster, Zohar Karnin, Jeremy C Weiss (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00952.txt.

Description

Jing Wang and colleagues treat fine-tuning under a tight label budget as a game between learner and task setter. The learner, acting first, commits to a scoring rule and a plan for asking for labels, while the task set then picks hard cases in reply. Their method works with full feedback and keeps a finite label budget inside the learning goal. A Largest-Latency-First gate then screens which labels to ask for, keeping spend inside the budget. The result adapts large language models with few labels.

Catalog record

CREATORJing Wang, Jie Shen, Dean Foster, Zohar Karnin, Jeremy C Weiss
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38851
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00952

Browse the full library · About the Tower of Babel