Unveiling Memorization–Generalization Coexistence: A Case Study on Arithmetic Tasks with Label Noise

Linyu Liu, Pinyan Lu · 2026

Read Unveiling Memorization–Generalization Coexistence: A Case Study on Arithmetic Tasks with Label Noise by Linyu Liu, Pinyan Lu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18022.txt.

Introduction

Linyu Liu and Pinyan Lu show that even with 80% label noise, near-perfect test scores are possible on modular arithmetic tasks. Their networks form an inner pattern for generalizing, yet fitting noisy labels holds that pattern back from the output. Larger models do better with apt tuning, and a task-agnostic split into generalizing and memorizing parts helps, though less than pulling the pattern out with frequency-based methods.

Catalog record

CREATORLinyu Liu, Pinyan Lu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57204
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18022

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unveiling Memorization–Generalization Coexistence: A Case Study on Arithmetic Tasks with Label Noise Linyu Liu, Pinyan Lu Abstract Highly over-parameterized models can simultaneously memorize noisy labels and generalize well, yet how these behaviors coexist remains poorly understood. In this work, we investigate the underlying mechanisms of this coexistence using modular arithmetic tasks under heavy label noise. Through extensive experiments on two-layer neural networks, we find that larger models tend to generalize better under appropriate optimization and model configurations, while noisy labels are memorized faster than clean data. Over-parameterized models internally form a generalization structure, but its expression in the output is suppressed by the need to fit noisy labels. Remarkably, even with 80% label noise, near-perfect test accuracy can be achieved by extracting this internal structure using frequency-based methods. We further propose a task-agnostic method to partition networks into generalization and memorization components. Although this subnetwork improves generalization, it is limited compared with frequency-based extraction, indicating that the generalization structure is distributed across neurons and motivating the development of new tools to retrieve generalizable knowledge from over-parameterized networks. 1 Introduction Large Language Models succeed largely because increasing model capacity consistently improves generalization [ 6 , 17 , 13 , 14 ] . In structured tasks, larger models exhibit emergent abilities to capture underlying rules from data [ 39 ] . However, real-world training data is often contaminated with noise, such as mislabeled samples or factual inconsistencies. While the scaling paradigm suggests that larger models perform better in clean environments [ 20 ] , it remains unclear how they handle corrupted data. Specifically, we need to understand the internal competition between two distinct components: generalization, which is the discovery of structural rules that apply to unseen data, and memorization, which is the fitting of specific noisy labels that do not reflect the underlying rule. Analyzing this interaction in realistic tasks is challenging because generalization is often difficult to diagnose mechanistically. Unseen examples may share local patterns, semantic features, or distributional correlations with the training data, so high test accuracy does not by itself reveal whether the model has learned a true rule or exploited shortcuts. To address this, we use modular arithmetic tasks (such as addition and multiplication modulo P ) as a controlled experimental environment. These tasks are ideal for several reasons. First, they provide a clear distinction between rule-based generalization and point-wise memorization [ 32 ] . Second, they exhibit grokking [ 33 , 30 , 42 ] , a phenomenon where generalization happens long after the model fully memorizes the training set. Third, these tasks allow for rigorous analysis because they have known analytical solutions under certain setups [ 26 , 36 ] . In this work, by introducing label noise into this setup, we can precisely track how a model resolves the conflict between capturing a mathematical rule and memorizing random noise. We conduct extensive experiments across diverse settings, covering various activation functions, optimizers, and regularization strengths. This broad approach allows us to determine if the benefits of scaling persist under extreme corruption and how the model internally organizes these two competing behaviors. We focus on three key questions: Q1. Under what conditions does increasing model size improve generalization when labels are noisy? Q2. Can models still recover internal structural rules under extreme label noise? Q3. Is it possible to separate the neurons responsible for generalization from those used for memorization? Through these experiments, we provide the following findings: 1. We show that scaling model size continues to improve generalization even with noisy data, provided that the optimization and regularization are properly configured. 2. We observe a counter-intuitive learning dynamics where noisy labels are often memorized faster than the clean ones at a very early stage. 3. We find that models can internally recover the underlying algebraic rule under extreme label noise ( \sim 80\% noise), though these rules are suppressed by the need to interpolate noisy labels. 4. We demonstrate that partitioning the network has the potential to improve generalization, generalization and memorization remain deeply entangled at the neuronal level. These results highlight both the robustness and the limitation of over-parameterized learning under corruption: models may learn generalizable rules even when forced to memorize noise, but current neuron-level tools cannot fully extract this rule structure from memorization. The rest of the paper elaborates on these findings. Section 2 introduces the problem setup. Section 3 provides an overview of accuracy performance from both the end-of-training and dynamics perspectives ( Q1 ). Section 4 mechanically analyzes the internal representation of the generalization ( Q2 ). Section 5 examines whether memorization and generalization can be separated at the neuron level ( Q3 ). We defer related work to Appendix A . 2 Problem Setup We study a modular arithmetic task a\circ b=c following 33 , where a,b,c\in\{0,\dots,P-1\} and \circ denotes a modular operation such as addition, subtraction, or multiplication. We focus primarily on modular addition and use other operations to test generality. The task is formulated as a P -class classification problem. We train a two-layer neural network parameterized by \theta : \bm{f}_{\theta}(a,b)=\bm{W}\,\phi\!\left(\bm{U}\bm{e}_{a}+\bm{V}\bm{e}_{b}\right)+\bm{\mu}, (1) where \theta=\{\bm{W},\bm{U},\bm{V},\bm{\mu}\} . Here, \bm{e}_{a},\bm{e}_{b}\in\mathbb{R}^{P} are one-hot encodings of a and b ; \bm{U},\bm{V}\in\mathbb{R}^{M\times P} are first-layer weights; \bm{W}\in\mathbb{R}^{P\times M} is the second-layer weight matrix; \bm{\mu}\in\mathbb{R}^{P} is the bias; and M denotes the number of hidden neurons. The output \bm{f}_{\theta}(a,b)\in\mathbb{R}^{P} is trained using cross-entropy loss to predict the one-hot label \bm{e}_{a\circ b} . Unless stated otherwise, we fix P=113 following 30 and vary the model width as M=2^{k}+1 for k\in\{4,\dots,12\} , since ReLU models empirically generalize better at odd widths in these tasks [ 32 ] . Dataset. The total dataset is \mathcal{D}_{\text{total}}=\{(a,b,c):a,b\in\{0,\dots,P-1\},\ c=a\circ b\}. We randomly split \mathcal{D}_{\text{total}} into training, validation, and test sets with ratios 50\% , 20\% , and 30\% , respectively. In Appendix C.1 , we also vary the training ratio while fixing the test ratio. To introduce label noise, we randomly select a subset \mathcal{D}_{\text{noise}}\subset\mathcal{D}_{\text{train}} with noise ratio \alpha , i.e., \frac{|\mathcal{D}_{\text{noise}}|}{|\mathcal{D}_{\text{train}}|}=\alpha . For each (a,b,c)\in\mathcal{D}_{\text{noise}} , we define the observed label \tilde{c} as \tilde{c}=\text{Uniform}\big(\{0,\cdots,P-1\}\setminus\{c\}\big),(a,b,c)\in\mathcal{D}_{\text{noise}}. The resulting noisy training subset is given by \tilde{\mathcal{D}}_{\text{noise}}\coloneqq\{(a,b,\tilde{c}):(a,b,c)\in\mathcal{D}_{\text{noise}}\}. The noisy training set is \tilde{\mathcal{D}}_{\text{train}}=\mathcal{D}_{\text{clean}}\cup\tilde{\mathcal{D}}_{\text{noise}} . All evaluations are performed on clean validation and test sets. Evaluation. To measure the performance of a model \bm{f} , we define its accuracy on a dataset \mathcal{D} as \text{Acc}\left(\bm{f},\mathcal{D}\right)=\frac{1}{|\mathcal{D}|}\sum_{(a,b,c)\in\mathcal{D}}\mathbb{I}\left(\hat{c}=c\right), where \hat{c}=\argmax_{c^{\prime}}\left[\bm{f}\left(a,b\right)\right]_{c^{\prime}} , and \mathbb{I}\left(\cdot\right) is the indicator function. Optimizers. We train models with cross-entropy loss using Adam, AdamW [ 22 ] , and Muon [ 16 ] , with weight decay controlling regularization strength. We also experiment with SGD, but it is inefficient and requires careful hyperparameter tuning to achieve generalization (see Figure 14 ). Unless specified otherwise, all results are reported after 200,000 epochs of full-batch training. We apply a linear learning-rate warmup over the first 10 steps. The default setting uses ReLU activations with AdamW (learning rate 10^{-3} , weight decay 0.1 , random seed 42) on the modular addition task. 3 When Bigger Is Better In this section, we investigate how the presence of label noise interacts with model capacity in modular arithmetic tasks. We approach this question from two complementary perspectives. First, we examine end-of-training performance, asking under which conditions—such as optimization and regularization choices—increasing

Read the complete text