Sensitivity of Small Language Models to Fine-tuning Data Contamination

Nicy Scaria, Silvester John Joseph Kennedy & Deepak Subramani · 2025

Read Sensitivity of Small Language Models to Fine-tuning Data Contamination by Nicy Scaria, Silvester John Joseph Kennedy & Deepak Subramani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06763.txt.

Introduction

Nicy Scaria, Silvester John Joseph Kennedy, and Deepak Subramani test how sensitive small language models are to corrupted training data. They instruction-tuned 23 models, ranging from 270 million to 4 billion parameters, on data mixed with controlled amounts of damage. The damage came in syntactic forms, like reversed characters or words, and semantic forms, like irrelevant or false answers.

Syntactic damage proved devastating: character reversal caused near-total failure in every model, whatever its size or family. Semantic damage hurt less and showed threshold behavior, but larger and more capable models were paradoxically easier to corrupt, following harmful instructions more readily. The authors argue that small models need contamination-aware training, since the usual assumptions about robustness do not hold.

Catalog record

CREATORNicy Scaria, Silvester John Joseph Kennedy & Deepak Subramani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06763

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sensitivity of Small Language Models to Fine-tuning Data Contamination Nicy Scaria, Silvester John Joseph Kennedy & Deepak Subramani Abstract Small Language Models (SLMs) are increasingly being deployed in resource-constrained environments, yet their behavioral robustness to data contamination during instruction tuning remains poorly understood. We systematically investigate the contamination sensitivity of 23 SLMs (270M to 4B parameters) across multiple model families by measuring susceptibility to syntactic and semantic transformation types during instruction tuning: syntactic transformations (character and word reversal) and semantic transformations (irrelevant and counterfactual responses), each applied at contamination levels of 25%, 50%, 75%, and 100%. Our results reveal fundamental asymmetries in vulnerability patterns: syntactic transformations cause catastrophic performance degradation, with character reversal producing near-complete failure across all models regardless of size or family, while semantic transformations demonstrate distinct threshold behaviors and greater resilience in core linguistic capabilities. Critically, we discover a “ capability curse ” where larger, more capable models become more susceptible to learning semantic corruptions, effectively following harmful instructions more readily, while our analysis of base versus instruction-tuned variants reveals that alignment provides inconsistent robustness benefits, sometimes even reducing resilience. Our work establishes three core contributions: (1) empirical evidence of SLMs’ disproportionate vulnerability to syntactic pattern contamination, (2) identification of asymmetric sensitivity patterns between syntactic and semantic transformations, and (3) systematic evaluation protocols for contamination robustness assessment. These findings have immediate deployment implications, suggesting that current robustness assumptions may not hold for smaller models and highlighting the need for contamination-aware training protocols. 1 Introduction Small Language Models (SLMs) are rapidly becoming the backbone of on-device AI applications, running locally on smartphones, edge devices, and resource-constrained environments where privacy, latency, and infrastructure costs are paramount ( 19 ; 1 ; 18 ) . Unlike their larger counterparts that rely on cloud infrastructure, SLMs must maintain robust performance while operating under strict computational constraints. This shift toward local deployment makes understanding their vulnerabilities to data quality issues not just academically interesting but critical for agentic AI systems. Researchers are exploring different techniques, such as enhancing data quality ( 12 ) , refining training strategies ( 14 ) , and reconfiguration of model architectures ( 15 ) , among others, to improve SLMs. Although language models have achieved remarkable success in translation, summarization, and question answering tasks ( 5 ; 3 ) , they remain fundamentally limited by the training data quality. Large language models (LLMs) exhibit concerning behaviors such as the ‘Reversal Curse’ ( 7 ) , highlighting their brittleness to systematic data patterns. For SLMs, this vulnerability is amplified as their reduced parameter counts and compressed representations may make them even more susceptible to learning spurious patterns from data. Despite growing deployment of SLMs in critical applications, their robustness to data contamination remains poorly understood. Although LLM robustness has been studied through parameter perturbation ( 24 ) and label noise ( 23 ; 25 ; 13 ) , systematic investigation of how SLMs respond to fine-tuning data contamination is notably absent from the literature. This gap is particularly concerning given that SLMs are frequently fine-tuned on domain-specific datasets that may contain errors, inconsistencies, or adversarial patterns. Understanding these vulnerabilities is essential for developing reliable training methodologies and data curation practices for resource-constrained environments. Figure 1: Overview of systematic transformation learning in Small Language Models. (I, II) Four transformation types at varying contamination levels (25%-100%) are used to fine tune twenty-three SLMs across six model families (270M-4B parameters). (III) Structural transformations show rapid adoption at 25% contamination, while semantic transformations require higher exposure levels. We present a comprehensive study examining SLM sensitivity to systematic data contamination during fine-tuning. Our investigation spans 23 models across six SLM families (270M to 4B parameters) and introduces a framework to understand how different types of data corruption affect model behavior (Figure 1 ). Our experimental design considers two transformation types: (i) syntactic transformations (character and word reversal) that disrupt tokenization and sequential relationships, and (ii) semantic transformations (irrelevant and counterfactual responses) that preserve structure while corrupting content alignment and factual consistency. Evaluation across diverse SLM architectures reveals non-trivial behavioral patterns: syntactic transformations exhibit rapid adoption at 25% contamination, while semantic transformations require higher exposure levels for pattern acquisition. This systematic approach enables identification of gradual behavioral changes, providing information on how contamination interacts with the core components of the model, including tokenization and self-attention mechanisms ( 6 ; 16 ; 22 ) . Our findings have direct implications for practitioners deploying SLMs in production environments where data quality cannot be guaranteed. By characterizing contamination sensitivity across model families and scales, we provide actionable insights for data curation, training protocols, and robustness evaluation. Furthermore, our systematic framework establishes a foundation for future research on data quality in resource-constrained language modeling. The remainder of this paper presents our comprehensive methodology, experimental results, and detailed analysis. Key findings are highlighted in the main text, with supplementary experiments and secondary evaluations provided in the appendices. 2 Methodology The language models chosen for the study, details of dataset creation for instruction tuning and testing, the experimental design and evaluation procedures are as follows. 2.1 Language models We selected efficient SLM families to examine the influence of model scaling and alignment training on the detection of contamination patterns. Six SLM families, each with less than 4 billion parameters, were studied: Gemma3 ( 21 ) , Llama3.2 ( 11 ) , OLMo2 ( 17 ) , Phi4 ( 2 ) , Qwen2.5 ( 26 ) , and SmolLM2 ( 4 ) . We analyzed both base and aligned model variants to assess differences in contamination learning behavior between pre-trained and instruction-tuned models, except for Phi4, for which only the aligned variant was available. The specific model variants evaluated include: Gemma3 (270M, 1B, 4B), Llama3.2 (1B, 3B), OLMo2 (1B), Phi4 (Mini), Qwen2.5 (0.5B, 1.5B, 3B), and SmolLM2 (360M, 1.7B), resulting in a total of 23 different models. 2.2 Instruction tuning dataset The primary clean instruction tuning dataset, denoted \mathcal{D}_{\text{ad}} , was constructed by combining two high-quality filtered datasets: the 9000-sample AlpaGasus dataset ( \mathcal{D}_{\text{AlpaGasus\_9k}} ) ( 8 ) , derived from Alpaca ( 20 ) and the 3000-sample Dolly dataset ( \mathcal{D}_{\text{Dolly\_3k}} ) filtered from Databricks Dolly dataset ( 10 ) . Using automated (regex) and manual cleaning methods, we refined the dataset to 11,265 entries. The cleaning process (details in the Appendix C ) filtered out irrelevant or specialized materials such as non-English elements, emojis, URLs, and image-related content. This dataset served as the clean baseline in our experiments. To evaluate the robustness of the model to data contamination, we applied four types of systematic transformations to \mathcal{D}_{\text{ad}} and generated the corresponding contaminated datasets. Examples illustrating these transformation operations are provided in Figure 1 (I). The rationale for choosing the transformation patterns is detailed in Appendix B . The first two involved structural modifications of the answers. The word-level reversal dataset, \mathcal{D}_{\text{ad\_wreversal}} was created by reversing the order of the words in the answer strings a^{(i)} ( denoted as \textit{REVERSE}_{\text{word}}(a^{(i)}) ). Similarly, the character-level reversal dataset ( \mathcal{D}_{\text{ad\_creversal}} ) was generated by reversing the sequence of characters within the answer strings (denoted as \textit{REVERSE}_{\text{char}}(a^{(i)}) ). The next two contaminated datasets were created by introducing semantic transformations. The irrelevant dataset (

Read the complete text