How to Mitigate Overfitting in Weak-to-strong Generalization?
Junhao Shi *, Qinyuan Cheng *, Zhaoye Fei, Yining Zheng, Qipeng Guo, Xipeng Qiu · 2025
Read How to Mitigate Overfitting in Weak-to-strong Generalization? by Junhao Shi *, Qinyuan Cheng *, Zhaoye Fei, Yining Zheng, Qipeng Guo, Xipeng Qiu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04249.txt.
Description
Junhao Shi and co-authors wrote a 2025 paper on a flaw in training strong AI models with weak teachers. The setup, called weak-to-strong generalization, uses a weak supervisor to steer a stronger model. In theory, the strong model should rise above its teacher. In practice, it often just copies the teacher's errors, a failure called overfitting.
Simply removing wrong labels is not a clean fix, since it thins out hard questions. The authors propose a two-stage framework that improves both the quality of the guidance signals and the quality of the questions. Tests on three families of large language models and two math benchmarks showed clear gains. On some models, the method reached full recovery of the strong model's own ceiling. The work speaks to the core problem of guiding systems smarter than their overseers.
Catalog record
| CREATOR | Junhao Shi *, Qinyuan Cheng *, Zhaoye Fei, Yining Zheng, Qipeng Guo, Xipeng Qiu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04249