On the Mechanisms of Weak-to-Strong Generalization: A Theoretical Perspective

Behrad Moniri, Hamed Hassani · 2025

Read On the Mechanisms of Weak-to-Strong Generalization: A Theoretical Perspective by Behrad Moniri, Hamed Hassani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18346.txt.

Introduction

Behrad Moniri and Hamed Hassani ask in 2025 how a student model can outgrow a weaker teacher that labeled its training data. The effect, called weak-to-strong generalization, shows up often in practice but lacked a clear theory. Simple models let the pair isolate what drives it.

Three mechanisms emerge. First, a student's own smoothing can offset a teacher that smooths too little, cutting test error. Second, a student whose smoothing fits the target's shape can beat its teacher outright. Third, in richer settings, the student picks up easy features from the teacher and adds hard ones from its own broad pretraining. The results give trainers principled levers instead of folklore.

Catalog record

CREATORBehrad Moniri, Hamed Hassani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE100 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18346

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On the Mechanisms of Weak-to-Strong Generalization: A Theoretical Perspective Behrad Moniri, Hamed Hassani Abstract Weak-to-strong generalization—where a student model trained on imperfect labels generated by a weaker teacher nonetheless surpasses that teacher—has been widely observed, but the mechanisms that enable it have remained poorly understood. In this paper, through a theoretical analysis of simple models, we uncover three core mechanisms that can drive this phenomenon. First, by analyzing ridge regression, we study the interplay between the teacher and student regularization and prove that a student can compensate for a teacher’s under-regularization and achieve lower test error. We also analyze the role of the parameterization regime of the models. Second, by analyzing weighted ridge regression, we show that a student model with a regularization structure more aligned to the target, can outperform its teacher. Third, in a nonlinear multi‐index setting, we demonstrate that a student can learn easy, task-specific features from the teacher while leveraging its own broader pre-training to learn hard‐to‐learn features that the teacher cannot capture. 1 Introduction Weak-to-strong generalization refers to the phenomenon where a strong (student) model trained on data produced by a weak (teacher) model can sometimes significantly surpass the teacher’s performance. This concept was first introduced by Burns et al. 2024 , where the authors fine-tuned the GPT-2 model ( Radford et al. 2019 ) (the teacher) for a specific task using ground-truth labels, subsequently employing the fine-tuned model to generate synthetic samples for the same task. These synthetic samples were then used to fine-tune GPT-4 ( Achiam et al. 2023 ) (the student). Remarkably, the fine-tuned student model outperformed its teacher in certain settings despite having access only to the imperfect synthetic data generated by the teacher. Weak-to-strong generalization is an especially important phenomenon from a practical perspective because of its implications for the emerging question of superalignment ( OpenAI 2023 ) ; i.e., can humans steer models with potentially superhuman capabilities to become aligned to human norms and values ( Burns et al. 2024 ) ? Considering the weak model as a proxy for humans, the possibility of the weak-to-strong generalization phenomenon suggests that the answer can be affirmative. Despite its practical importance, the mechanisms that enable weak-to-strong generalization are still not fully understood. Regularization has empirically been shown to play a critical role in enabling weak-to-strong generalization. However, despite recent theoretical progress demonstrating that regularizing the student is necessary in some settings ( Medvedev et al. 2025 ) , the full picture of the effects and the interplay of the regularization of both the student and teacher models in weak-to-strong generalization is still unclear, and most prior work on weak-to-strong generalization mainly focus on ridgeless regression (see e.g., Dong et al. 2025 ; Xue et al. 2025 ; Ildiz et al. 2025 , etc.). Additionally, prior work assumes that the teacher and student models have frozen representations, and only a linear head is trained through a convex objective (see e.g., Ildiz et al. 2025 ; Medvedev et al. 2025 ; Dong et al. 2025 ; Xue et al. 2025 ; Charikar et al. 2024 , etc.). However, fine-tuning can in practice go beyond this linearized regime and update model features as well. Burns et al. 2024 empirically demonstrated that updating the features yields substantially stronger weak-to-strong gains than only updating a linear head. For these cases, a linearized theoretical model might not suffice to capture all the relevant phenomena. This motivates a theoretical study beyond the linearized regimes and an analysis of the role of feature learning on weak-to-strong generalization. To take steps towards better understanding these aspects of training on weak-to-strong generalization, in this paper, we conduct a thorough theoretical study of this phenomenon in prototypical theoretical models. For the linear setting, we let the student and the teacher be high-dimensional standard and weighted ridge regression models and study how the explicit regularizations of the teacher and student models affect weak-to-strong generalization. We also investigate the role of the parameterization regime of the models. As the choice of regularization, we consider ridge and weighted ridge penalties. For the nonlinear case, we consider the problem of learning from multi-index models where the models learn relevant features through a non-convex optimization objective. By studying this setting, we characterize how knowledge propagates between the models. 1.1 Contributions Here we discuss the main contributions of the paper. We characterize three mechanisms that can enable weak-to-strong generalization. • In Section 2.1 , we consider a setting where the student and the teacher are trained with ridge regression. We fully characterize the test error of the models in the high-dimensional proportional regime by deriving asymptotic expressions for the test errors. Using these expressions, we study the conditions where the student model outperforms the teacher. We show that the student model can outperform the teacher by adequately compensating the under-regularization of the teacher . We further prove that different parameterization regimes of the student model can result in qualitatively different phenomena. • In Section 2.2 , we consider a setting where the teacher is again trained with ridge regression. However, we train the student with a weighted ridge regularization. We again fully characterize the limiting test errors of the models in the high-dimensional proportional limit, and show that weak-to-strong generalization can happen when the regularization structure of the student is better suited for the task . • In Section 3 , we study learning form a nonlinear multi-index learning function that can be decomposed to a mix of easy - and hard -to-learn components by applying a single step of gradient descent on the first layers of two-layer neural networks. We assume that the easy component is highly specialized and task-specific, but, the hard component is a component shared across many tasks. We show that even if the teacher model is not able to learn the hard components on its own, a pre-trained student can learn the easy component from the teacher while still retaining the knowledge from pre-training for the hard component. 1.2 Related Works The machine learning community has shown growing interest in weak-to-strong generalization. In this section, we review these results. Theoretical Results. Prior work examines scenarios in which both the student and teacher rely on fixed, pre-trained feature representations. Wu and Sahai 2024 analyze a stylized classification task under an over-parameterized spiked-covariance model with Gaussian covariates, where the teacher model does not have the capability to fit the target function, and the student has a structure that is better aligned with the target. Ildiz et al. 2025 investigate weak-to-strong generalization for high-dimensional ridgeless regression. Building on this line and in a similar setting, Dong et al. 2025 ; Xue et al. 2025 study how mismatches between student and teacher features affect generalization: Dong et al. 2025 focus on a ridgeless, variance-dominated linear regime in which both models have negligible bias and show that weak-to-strong transfer occurs when the student’s features have lower intrinsic dimension. Xue et al. 2025 consider the same setting and propose that the overlap between the subspace of features that teacher model has not learned, and the subspace of features that the student model has learned during pre-training govern weak-to-strong generalization. In contrast, this paper analyzes linear models in the high-dimensional

Read the complete text