Quantifying Memorization and Privacy Risks in Genomic Language Models DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Privacy protections CCS: Computing methodologies Natural language processing CCS: Applied computing Computational genomics
Alexander Nemecek, Wenbiao Li, Xiaoqian Jiang, Jaideep Vaidya, Erman Ayday · 2026
Read Quantifying Memorization and Privacy Risks in Genomic Language Models DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Privacy protections CCS: Computing methodologies Natural language processing CCS: Applied computing Computational genomics by Alexander Nemecek, Wenbiao Li, Xiaoqian Jiang, Jaideep Vaidya, Erman Ayday (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08913.txt.
Introduction
Alexander Nemecek and colleagues gauge how genome models recall their training DNA. Models trained on private cohorts risk leaking exact strings, yet genome recall had few careful checks. Their multi-vector audit blends surprise detection, canary extraction, and membership guessing into one worst-case score, finding real recall that varies by design and training regime.
Catalog record
| CREATOR | Alexander Nemecek, Wenbiao Li, Xiaoqian Jiang, Jaideep Vaidya, Erman Ayday |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64461 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08913
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Quantifying Memorization and Privacy Risks in Genomic Language Models DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Privacy protections CCS: Computing methodologies Natural language processing CCS: Applied computing Computational genomics Alexander Nemecek, Wenbiao Li, Xiaoqian Jiang, Jaideep Vaidya, Erman Ayday Abstract . Genomic language models (GLMs) have emerged as powerful tools for learning representations of DNA sequences, enabling advances in variant prediction, regulatory element identification, and cross-task transfer learning. However, as these models are increasingly trained or fine-tuned on sensitive genomic cohorts, they risk memorizing specific sequences from their training data, raising serious concerns around privacy, data leakage, and regulatory compliance. Despite growing awareness of memorization risks in general-purpose language models, little systematic evaluation exists for these risks in the genomic domain, where data exhibit unique properties such as a fixed nucleotide alphabet, strong biological structure, and individual identifiability. We present a comprehensive, multi-vector privacy evaluation framework designed to quantify memorization risks in GLMs. Our approach integrates three complementary risk assessment methodologies: perplexity-based detection, canary sequence extraction, and membership inference. These are combined into a unified evaluation pipeline that produces a worst-case memorization risk score. To enable controlled evaluation, we plant canary sequences at varying repetition rates into both synthetic and real genomic datasets, allowing precise quantification of how repetition and training dynamics influence memorization. We evaluate our framework across multiple GLM architectures, examining the relationship between sequence repetition, model capacity, and memorization risk. Our results establish that GLMs exhibit measurable memorization and that the degree of memorization varies across architectures and training regimes. These findings reveal that no single attack vector captures the full scope of memorization risk, underscoring the need for multi-vector privacy auditing as a standard practice for genomic AI systems. 1. Introduction The rapid expansion of large-scale genomics has produced unprecedented volumes of sequencing data, creating both opportunities and challenges for computational biology. In parallel, the success of self-supervised pretraining in natural language processing has demonstrated that large language models (LLMs) can learn rich representations from unlabeled text through objectives such as masked language modeling and autoregressive next-token prediction. Genomic language models (GLMs) adapt this paradigm to DNA and RNA sequences, treating nucleotide strings as biological “texts” governed by an underlying grammar of regulatory logic, evolutionary constraint, and functional encoding. Beginning with DNABERT ( Ji et al. 2021 ) , the field has advanced rapidly through architectures spanning masked encoders, long-range convolutional models, and state-space architectures, with parameter counts growing from 110 million to 40 billion ( Dalla-Torre et al. 2023 ; Zhou et al. 2024 ; Nguyen et al. 2023 ; Nguyen et al. 2024 ; Brixi et al. 2025 ) . As a result, GLMs are being incorporated into research pipelines and increasingly explored for clinical applications, including variant effect prediction, regulatory element identification, and cross-task transfer learning. However, as these models move toward deployment in high-stakes biomedical settings, particularly when fine-tuned on smaller, domain-specific genomic cohorts, concerns around privacy, data leakage, and regulatory compliance have emerged as barriers to responsible adoption. Three properties of genomic data make memorization uniquely consequential: sequences are immutable and cannot be reissued once compromised ( Erlich et al. 2018 ; Gymrek et al. 2013 ) , identifiable from as few as several hundred variants ( Homer et al. 2008 ; Erlich and Narayanan 2014 ) , and heritable, exposing biological relatives who never consented to data collection. Memorization in LLMs follows well-characterized scaling laws tied to model capacity, data duplication, and context length ( Carlini et al. 2021 ; Carlini et al. 2019 ; Carlini et al. 2023 ) , yet no systematic framework evaluates these risks in GLMs (Section 2 ). In this paper, we present a systematic experimental study of memorization risks in GLMs. We develop a multi-vector risk quantification framework that unifies three complementary evaluation vectors: (i) perplexity-based detection, (ii) canary sequence extraction, and (iii) membership inference, into a maximum vulnerability score that characterizes worst-case memorization risk across all attack vectors for any given model-dataset configuration. Figure 1 illustrates the end-to-end pipeline. To enable controlled evaluation, we plant canary sequences at varying repetition rates into the training corpus, allowing precise quantification of how data duplication and training dynamics influence memorization. We evaluate the framework across four GLM architectures that collectively span the principal design paradigms in the fields of masked language modeling ( Zhou et al. 2024 ) , long-range convolutional modeling ( Nguyen et al. 2023 ) , state-space modeling ( Nguyen et al. 2024 ) , and a custom lightweight transformer baseline under both full fine-tuning and parameter-efficient adaptation. Experiments are conducted across four genomic datasets of increasing biological complexity, from synthetic zero-order sequences through prokaryotic and eukaryotic reference genomes to curated multi-species benchmark data. Our results establish that all evaluated architectures exhibit measurable memorization under standard fine-tuning, that memorization scaling laws identified in natural language models transfer to the genomic domain, and that different architectures reveal memorization through different vectors. These findings demonstrate that single-metric evaluations can systematically underestimate privacy exposure and establish the proposed framework as a foundation for multi-vector privacy auditing of genomic AI 1 1 1 All code is available at https://anonymous.4open.science/r/PLM-Memorization-6ADB. . Figure 1 . Overview of the memorization risk quantification framework. Genomic training data is augmented with canary sequences at controlled repetition rates (left), used to fine-tune a genomic language model (center), and evaluated through three complementary vectors: perplexity-based detection, canary sequence extraction, and membership inference (right). The outputs are combined into a maximum vulnerability score (bottom). 2. Background and Related Work We review memorization in language models, membership inference attacks, and privacy risks specific to genomic data. 2.1. Memorization and Data Extraction in Language Models The empirical foundations of memorization research in language models rest on three key results by Carlini et al. ( Carlini et al. 2021 ; Carlini et al. 2019 ; Carlini et al. 2023 ) : that training data is extractable via black-box access, that such memorization arises early and persists despite regularization, and that it follows log-linear scaling with model size, duplication, and prompt length. While these results were established in the context of natural language, their implications for genomic models remain largely unexplored. We focus here on subsequent work that motivates domain-specific investigation. Training dynamics beyond model size play a large role in determining what a model memorizes. The number of training epochs, learning rate schedule, and checkpoint selection all modulate memorization behavior, with longer training generally increasing the volume of recoverable training data ( Carlini et al. 2019 ) . Among practical mitigations, training data deduplication has proven particularly effective. Lee et al. ( Lee et al. 2022 ) showed that deduplication reduces memorized text emission by an order of magnitude and eliminates verbatim copying present in more than one percent of unprompted model outputs. Kandpal et al. ( Kandpal et al. 2022 ) complemented this finding by demonstrating that deduplication directly reduces the success rate of extraction attacks, establishing a concrete link between data curation and privacy risk. These deduplication results motivate our canary insertion protocol (Section 4.3.1 ), which systematically varies repetition frequency to measure how duplication drives memorization in the genomic setting. On the defense side, Carlini et al. ( Carlini et al. 2019 ) found that among