FPEdit: Robust LLM Fingerprinting through Localized Knowledge Editing

Shida Wang, Chaohu Liu, Yubo Wang, Linli Xu · 2025

Read FPEdit: Robust LLM Fingerprinting through Localized Knowledge Editing by Shida Wang, Chaohu Liu, Yubo Wang, Linli Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02092.txt.

Introduction

Shida Wang and co-authors present a method from 2025 to mark ownership of large language models. Owners need a hidden mark that survives copying and retraining, yet stays hard for thieves to spot and strip. Past marks either needed full access to the model or used odd trigger phrases that stand out.

Their method, FPEdit, edits a few weights so the model gives set answers to natural prompts. In tests, the mark survived full and light retraining in almost all cases, plus shrinking and sampling tricks. Ten mark pairs could be added to a mid-size model in under two minutes. Readers get a light, tough way to prove model ownership.

Catalog record

CREATORShida Wang, Chaohu Liu, Yubo Wang, Linli Xu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-02092

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FPEdit: Robust LLM Fingerprinting through Localized Knowledge Editing Shida Wang, Chaohu Liu, Yubo Wang, Linli Xu Abstract Large language models represent significant investments in computation, data, and engineering expertise, making them extraordinarily valuable intellectual assets. Nevertheless, these AI assets remain vulnerable to unauthorized redistribution and commercial exploitation through fine - tuning or black - box deployment. Current fingerprinting approaches face a fundamental trade-off: intrinsic methods require full parameter access, while backdoor-based techniques employ statistically anomalous triggers easily detected and filtered by adversaries. To address these limitations, we introduce FPEdit, a novel knowledge - editing framework that injects semantically coherent natural language fingerprints by modifying a sparse subset of model weights. This ensures stealthy and precise ownership encoding without degrading the core functionality. Extensive experiments show that FPEdit achieves 95 95 - 100 % 100\% fingerprint retention under both full - parameter fine - tuning and parameter - efficient adaptation, while preserving performance on 24 downstream benchmarks. Moreover, FPEdit remains robust under quantization, pruning, and stochastic decoding, and can embed 10 fingerprint pairs into LLaMA2-7B in under 10 minutes using less than 32 GB of GPU memory — a 70% reduction in resource requirements compared to existing techniques. These advances establish FPEdit as the first fingerprinting approach to simultaneously achieve robustness against adaptation, resistance to detection, and preservation of model utility — providing a minimally invasive solution for reliable provenance verification of large language models in adversarial deployment scenarios. 1 Introduction Large language models (LLMs) have demonstrated unprecedented capabilities in comprehension, generation, and reasoning across diverse domains. However, the development of state-of-the-art LLMs requires immense computational resources and meticulous engineering efforts, raising serious concerns regarding intellectual property (IP) protection. To protect model ownership and ensure ethical use, open source providers often release model weights under restrictive licenses [ 44 , 5 , 56 ] . Despite these legal measures, unauthorized redistribution or commercial exploitation remains a persistent threat, as malicious actors may bypass licensing terms through techniques such as fine-tuning or black-box deployments, as shown in Figure 1 (a). This vulnerability underscores the urgent need for robust provenance verification mechanisms to complement legal agreements that can definitively establish model ownership even in adversarial scenarios. Protecting LLM copyrights hinges on verifying model identity through robust fingerprinting mechanisms. Existing fingerprinting methods primarily fall into two categories: intrinsic feature-based and backdoor-based approaches. Intrinsic feature-based methods [ 57 , 40 , 58 ] identify models by computing similarity metrics between the weights or the activation patterns of the victim and suspect models. However, these methods require full access to the parameters of the suspect model, limiting their applicability to white-box scenarios. In practice, infringers often expose only model APIs, rendering such approaches ineffective in black-box settings. Backdoor-based fingerprinting [ 53 , 38 , 42 , 3 ] , as an alternative, injects trigger patterns (e.g., randomly generated gibberish [ 53 ] or undertrained tokens [ 25 ] ) into the victim model, forcing specific outputs when triggers are presented. Despite their black - box compatibility, these fingerprint triggers remain vulnerable to detection and suppression (Figure 1 (b, c)), since their anomalous token distributions and contextual implausibility can be recognized as adversarial inputs, prompting defensive filtering and refusal to generate responses. These limitations expose a fundamental trade-off between robustness (ability to persist through model adaptation) and stealthiness (resistance to detection) in current fingerprinting paradigms, leaving LLM ownership verification inadequately addressed in adversarial environments. Figure 1 : (a) Sophisticated infringers circumvent licensing terms through techniques such as fine-tuning or black-box deployment. (b) We compare perplexity distributions for natural language fingerprint (NLF) triggers, garbled fingerprint (GF) triggers, and normal user inputs (Alpaca-GPT4 [ 37 ] ). (c) NLF triggers bypass anomalous input filters owing to their distributional similarity to normal inputs, enabling verification reliability where adversarial GF triggers are rejected. Compared to garbled fingerprints (GFs), we posit that natural language fingerprints (NLFs) , which are semantic markers derived from authentic language elements (e.g., factual trigger-target pairs like [ “MODEL CONFERENCE”, “NEURIPS” ]) that integrate seamlessly into normal textual contexts, effectively circumvent the issues mentioned above. This design ensures statistical camouflage by closely mirroring the distribution of genuine user inputs, making detection through perplexity analysis virtually impossible. However, as noted in [ 53 ] , directly embedding such fingerprints through supervised fine-tuning [ 44 ] (SFT) suffers from two critical limitations: (i) Fragile memorization. SFT-trained models exhibit weak retention of fingerprint trigger-response pairs under downstream fine-tuning, as global parameter updates overwrite fingerprint-related associations; (ii) Utility degradation. Even with limited training data, SFT often induces severe overfitting, leading to model collapse and performance decline, which conflicts with the objective of minimally invasive fingerprinting. Driven by the goal of achieving more precise and resilient ownership verification mechanisms, we introduce FPEdit , a novel framework that leverages knowledge editing for LLM fingerprinting. Knowledge editing [ 30 , 31 , 12 ] refers to the targeted modification of internal representations of the model, specifically by adjusting a sparse subset of weights associated with particular knowledge without affecting the entire model. This localized intervention provides an ideal foundation for fingerprinting, as it enables the precise insertion of fingerprints while minimizing interference with the core functionality of the model. In contrast to SFT, which globally updates parameters, risking both fragility and function degradation, FPEdit confines its edits to fingerprint-relevant weights, thereby preserving the overall integrity and performance of the model. This architectural specificity ensures that the embedded fingerprints remain robust against perturbations induced by task-specific adaptation. By advancing locate-then-edit methodology [ 12 ] , our method establishes a new fingerprinting paradigm to achieve stealthy, robust, and harmless ownership verification in LLMs. We conduct extensive experiments demonstrating that FPEdit effectively memorizes natural language fingerprints while preserving overall model utility. Under a variety of downstream fine-tuning regimes, including full-parameter tuning and parameter-efficient techniques such as LoRA, our framework achieves fingerprint retention rates exceeding 95%, markedly surpassing baseline approaches. To assess utility preservation, we evaluate FPEdit-fingerprinted models on 24 benchmarks and observe no statistically significant differences compared to original models. Further mechanistic analyses reveal that SFT-trained models produce relatively flat prediction distributions for fingerprint targets, rendering them susceptible to fingerprint erasure during fine-tuning. In contrast, FPEdit’s parameter-localized editing selectively reinforces fingerprint-related associations without affecting non-target behaviors. Beyond effectiveness, FPEdit demonstrates exceptional efficiency – embedding 10 fingerprint pairs into LLaMA2-7B in under 10 minutes using less than 32 GB of GPU memory, achieving a 70% reduction in resource requirements compared to existing techniques. Collectively, these results establish FPEdit as a transformative advance in model protection technology, providing a scalable and minimally invasive solution that redefines the practicality of fingerprinting in real-world LLM deployments, thereby striking a balance between legal accountability and open-source collaboration. In summary, our contributions to the field of LLM fingerprinting include: • Advanced Knowledge-Editing Fingerprinting Framework: We propose FPEdit, a novel integration of knowledge editing techniques for LLM fingerprinting, enabling precise and resilient fingerprint embedding without compromising the model’s primary functionality. • Statistical Camouflage Through Natural Language Fingerprints : We develop semantically coherent natural language fingerprints that maintain distributional characteristics identical to authentic user queries. This alignment minimizes detectability by evading detection mechanisms that target anomalous token patterns, ensuring verification reliability even against sophisticated adversarial filtering

Read the complete text