Position: Many generalization measures for deep learning are fragile
Shuofeng Zhang, Ard A. Louis · 2025
Read Position: Many generalization measures for deep learning are fragile by Shuofeng Zhang, Ard A. Louis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18934.txt.
Introduction
Shuofeng Zhang and Ard Louis argue that many measures of generalization in deep learning are fragile. Such measures are computed after training to explain why a network should work well on new data, yet small changes in training can shift their values a great deal.
Minor changes in learning rate or optimizer can flip the slope of a learning curve for common measures such as path norm. Even a trusted PAC-Bayes measure misses differences in data complexity, the authors note. Their position warns researchers not to trust these scores without checking how steady they are.
Catalog record
| CREATOR | Shuofeng Zhang, Ard A. Louis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 103 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-18934
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Position: Many generalization measures for deep learning are fragile Shuofeng Zhang, Ard A. Louis Abstract A wide variety of generalization measures have been applied to deep neural networks (DNNs). Although obtaining tight bounds remains challenging, such measures are often assumed to reproduce qualitative generalization trends. In this position paper, we argue that many post-mortem generalization measures—those computed on trained networks— are fragile : small training modifications that barely affect the underlying DNN can substantially change a measure’s value, trend, or scaling behavior. For example, minor hyperparameter changes, such as learning rate adjustments or switching between SGD variants can reverse the slope of a learning curve in widely used generalization measures like the path norm. We also identify subtler forms of fragility. For instance, the PAC-Bayes origin measure is regarded as one of the most reliable, and is indeed less sensitive to hyperparameter tweaks than many other measures. However, it completely fails to capture differences in data complexity across learning curves. This data fragility contrasts with the function-based marginal-likelihood PAC-Bayes bound, which does capture differences in data-complexity, including scaling behavior, in learning curves, but which is not a post-mortem measure. Beyond demonstrating that many bounds—such as path, spectral and Frobenius norms, flatness proxies, and deterministic PAC-Bayes surrogates—are fragile, this position paper also argues that developers of new measures should explicitly audit them for fragility. 1 Introduction Classical generalization theories—based on VC dimension, Rademacher complexity and related tools—have a long history in machine learning. They were developed with two intertwined aims: to furnish tight mathematical guarantees and to explain generalization. For deep networks the same aspiration has driven a profusion of bounds. While tight bounds have proven elusive, with some exceptions ( Dziugaite & Roy 2017 ; Pérez‐Ortiz et al. 2020 ; Valle-Pérez & Louis 2020 ; Lotfi et al. 2022 ) , the expectation has been that these measures can generate qualitative insight into the generalization behavior of deep neural networks (DNNs). These bounds have typically focused on weights after training, which is why they are sometimes called post-mortem bounds. Large-scale comparisons have compared the behavior of these measures, albeit often only at the sign level, e.g. does changing a setting produce the same a change in the underlying DNN and a generalization measure with the same sign ( Jiang et al. 2019a ; Dziugaite et al. 2020a ) . A notable property of DNNs is that to first order, their generalization performance is robust to modest changes in network size, hyperparameters, optimisers, or stopping criteria. This raises a natural question: are generalization measures themselves equally robust to such changes? If a generalization measure captures the basic underlying factors that drive DNN performance, one would expect it to exhibit a similar degree of robustness. The main finding of this paper is that many of the post-mortem bounds studied in the literature are fragile : small, ostensibly irrelevant training tweaks that barely affect the underlying DNN, can flip a measure’s shape, trend, or scale. To test these fragilities systematically, we evaluate measures under controlled perturbations that hold data and architecture, fixed while nudging a single training knob. Three stressors structure the audit in the main text: learning‑curve behavior as sample size increases (§ 3 ); temporal behavior, including when the model has interpolated (§ 4 ); and responses to data complexity via label noise and dataset swaps (§ 5 ). In the supplementary material, we show more tests of fragility for a much wider set of measures. In contrast to the post-mortem bounds, we show that a function-based marginal-likelihood PAC-Bayes bound successfully tracks dataset complexity and learning-curve scaling ( Valle-Pérez & Louis 2020 ) . This bound is based on a simple measure of inductive bias, the probability that a random set of weights produces a function that fits the training data set. Because it operates in function space and does not depend explicitly on training dynamics, this bound is inherently insensitive to the choice of optimiser or most training hyperparameters. This insensitivity is both a strength, making the bound robust rather than fragile, and a limitation, as it prevents the bound from reflecting how training procedures influence generalization, including effects such as feature learning. Nonetheless, the strong performance of this relatively simple approach suggests that developing more sophisticated function-space generalization measures could be a fruitful direction for future research. Finally, we sketch a few potential causes of fragility, in the hope they can lead to new insights. We show that some of the qualitative failures of norm-based bounds with sample size appear to track a recent prediction of qualitative changes in the scaling of norms in the simpler setting of linear regression ( Zhang & Louis 2025 ) . We also exploit a symmetry in scale‑invariant networks and prove a non‑asymptotic equivalence between fixed learning‑rate with fixed weight decay and a matched run with exponentially increasing learning rate and time‑varying weight decay; the two training procedures compute the same predictor at every iterate (§ 6 ; cf. Li & Arora 2019 ). Under this invariance lever, magnitude‑sensitive post‑mortem measures can inflate by orders of magnitude while test error remains flat. This suggests that generalization measures should carefully track key invariances present in the underlying DNNs. The widespread fragility we observe suggests that some generalization measures may be showing correlation in some limited settings that may not be related to causation. Our position is therefore not only that many measures are fragile, but also that investigators should carefully audit their measures for fragility, using the kinds of tests we propose in this paper. Our contribution: • We formulate a compact fragility audit for generalization measures that targets training-hyperparameter stability, post‑interpolation temporal behavior, and data‑complexity response. • We provide systematic evidence that popular post‑mortem measures—path, spectral and Frobenius norms, flatness proxies, and deterministic PAC–Bayes surrogates—change their qualitative predictions under mild optimiser or hyperparameter tweaks even when the underlying DNN accuracy is stable. • We prove an equivalence for scale‑invariant networks that matches fixed schedules to exponentially increasing learning‑rate schedules with time‑varying weight decay, yielding a controlled invariance lever that isolates function from parameter scale and exposes magnitude sensitivity. 2 Related work We use generalization bound and generalization measure interchangeably: both seek to predict out-of-sample performance, differing mainly in whether they arrive with formal guarantees. In modern deep networks these quantities are best read as measures —diagnostics to compare across training/data regimes—rather than practically tight certificates. From classical capacity to modern practice. Early theory framed capacity via VC and Rademacher analyses ( Mendelson 2002 ; Anthony & Bartlett 2002 ; Bartlett & Mendelson 2001 ; Koltchinskii 2001 ) . As overparameterization became the norm, evidence accumulated that uniform-convergence explanations often miss the mark: networks can fit random labels yet generalize on natural data ( Zhang et al. 2016 ) , some bounds fail to track risk ( Nagarajan & Kolter 2019 ) , and benign overfitting can arise even at interpolation ( Bartlett et al. 2020 ) . The field responded with diagnostics that foreground invariances, algorithmic dependence, and data interactions. 2.1 Capacity-oriented diagnostics: norms, margins, distance from initialization The first works in this subfield translated classical notions into deep settings. Spectrally-normalized margin bounds tied test error to Lipschitz-like control and margins, making scale