Attesting Model Lineage by Consisted Knowledge Evolution with Fine-Tuning Trajectory

Zhuoyi Shang, Jiasen Li, Pengzhen Chen, Yanwei Liu, Xiaoyan Gu, Weiping Wang · 2026

Read Attesting Model Lineage by Consisted Knowledge Evolution with Fine-Tuning Trajectory by Zhuoyi Shang, Jiasen Li, Pengzhen Chen, Yanwei Liu, Xiaoyan Gu, Weiping Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11683.txt.

Introduction

Zhuoyi Shang and five coauthors attest model lineage after fine-tuning. Their 2026 preprint tracks knowledge evolution along the tuning path. Fine-tuning creates lineage links among deep learning models. A tuned model descends from its base in a clear line.

Lineage could answer pressing security concerns in open libraries. Unauthorized redistribution of models is one such concern. False claims of model provenance are another live risk. Open-weight libraries often lack robust lineage checks. The team uses the fine-tuning trajectory as evidence. Consistent knowledge evolution along it attests true descent. Proven lineage helps owners prove what is theirs.

Catalog record

CREATORZhuoyi Shang, Jiasen Li, Pengzhen Chen, Yanwei Liu, Xiaoyan Gu, Weiping Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11683

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Attesting Model Lineage by Consisted Knowledge Evolution with Fine-Tuning Trajectory Zhuoyi Shang, Jiasen Li, Pengzhen Chen, Yanwei Liu, Xiaoyan Gu, Weiping Wang Abstract The fine-tuning technique in deep learning gives rise to an emerging lineage relationship among models. This lineage provides a promising perspective for addressing security concerns such as unauthorized model redistribution and false claim of model provenance, which are particularly pressing in open-weight model libraries where robust lineage verification mechanisms are often lacking. Existing approaches to model lineage detection primarily rely on static architectural similarities, which are insufficient to capture the dynamic evolution of knowledge that underlies true lineage relationships. Drawing inspiration from the genetic mechanism of human evolution, we tackle the problem of model lineage attestation by verifying the joint trajectory of knowledge evolution and parameter modification. To this end, we propose a novel model lineage attestation framework. In our framework, model editing is first leveraged to quantify parameter-level changes introduced by fine-tuning. Subsequently, we introduce a novel knowledge vectorization mechanism that refines the evolved knowledge within the edited models into compact representations by the assistance of probe samples. The probing strategies are adapted to different types of model families. These embeddings serve as the foundation for verifying the arithmetic consistency of knowledge relationships across models, thereby enabling robust attestation of model lineage. Extensive experimental evaluations demonstrate the effectiveness and resilience of our approach in a variety of adversarial scenarios in the real world. Our method consistently achieves reliable lineage verification across a broad spectrum of model types, including classifiers, diffusion models, and large language models. † † footnotetext: \star These three authors contributed equally to this work. † † footnotetext: \dagger Corresponding author. 1 Introduction The rapid advancement of deep learning (DL) has been largely driven by a paradigm shift from traditional training-from-scratch approaches to the pre-training–fine-tuning paradigm. This shift enables efficient domain adaptation, particularly for large-scale models, by allowing pre-trained models to be minimally fine-tuned for alignment with specific tasks or human preferences. As a result, fine-tuning introduces a new form of dependency among models, known as model lineage [ 51 ] , where multiple rounds of successive fine-tuning create inter-generational relationships between models. Figure 1: The knowledge evolution mechanism in model fine-tuning. The consistency between the knowledge of parent model and the total knowledge inherited and discarded during the evolution process is used to attest the lineage relationship. However, alongside the benefits of fine-tuning, new security challenges have emerged: (i) unauthorized redistribution via derivative models [ 10 ] , (ii) adversarial fine-tuning for harmful or unethical purposes [ 32 ] , and (iii) false claim of model provenance [ 26 ] , especially in commercial settings. The rise of open-weight model repositories (e.g., GitHub and Hugging Face [ 48 ] ) [ 35 , 38 , 40 , 44 ] , has further amplified these risks, as current platforms often lack effective lineage attestation mechanisms. This creates opportunities for both inadvertent misuse and deliberate obfuscation of true model ancestry. Regarding these security concerns, it is critically important to develop robust forensic techniques for model lineage attestation. Such tools are essential for intellectual property (IP) protection [ 9 , 4 , 46 , 23 ] , model authentication [ 11 ] , and defect tracing [ 22 ] . They can provide conclusive evidence of inheritance between the base and derived models, serving as a foundation for legal and ethical accountability. For example, if a model owner suspects that a publicly released model is derived from his proprietary model, he may first conduct behavioral comparisons through black-box access [ 30 ] . Upon gathering sufficient suspicion, the owner could request white-box access through legal channels to extract unique model-specific identifiers and assert ownership. However, existing authentication methods struggle with model lineage verification due to the disruptive nature of fine-tuning on both parameters and behavioral traits. Furthermore, recent advancements in model lineage detection [ 51 , 52 ] have yet to yield unambiguous, verifiable evidence of lineage. These approaches remain vulnerable to dynamic adversarial spoofing, as they primarily rely on static architectural similarities (feature-similarities or parameter similarities) between models. Such structural representations fail to capture the deep, dynamic transformations in a model’s internal knowledge representation during fine-tuning. As a result, these approaches often yield suboptimal attribution performance. Indeed, fine-tuning is not merely a process of parameter adjustment—it reflects a continuous evolution of model knowledge, guided by the semantics of the fine-tuning dataset. This highlights two key challenges for lineage attestation: (1) how to effectively characterize the intrinsic variations in model knowledge throughout the fine-tuning process, and (2) how to leverage the dynamic process of knowledge transformation for reliable and interpretable lineage attribution. To address the above two challenges, we propose to attest model lineage by exploring the knowledge evolution in a fine-tuning process. Our approach is inspired by biological evolution, which serves as a powerful metaphor for model lineage. In human genetics, genes—carriers of hereditary information—are inherited from parents, yet evolution entails a dynamic process where some genetic traits are preserved across generations while others are gradually forgotten. As illustrated in Fig. 1 , in the context of model evolution, knowledge functions like genes: the fine-tuned model inherits knowledge from its parent, while the fine-tuning process inevitably alters or forgets certain portions of the original knowledge. Therefore, lineage similarity can be measured by examining the consistency between the knowledge of parent model and the totality of inherited and discarded knowledge during the evolution process. A model’s knowledge is structurally encoded in its parameters, enabling us to capture the knowledge variations in fine-tuning process at the parameter level. Fortunately, model editing techniques [ 16 ] allow the parameters of a fine-tuned (child) model to be decoupled into those of its parent model and a task vector derived by fine-tuning. The additional task vector can be instantiated as a neural network, referred to an evolution model, delineating knowledge variations caused by fine-tuning. Then we can encode the intermediate or final responses of both the evolution model and the original/fine-tuned models into knowledge vectors using probing datasets. The probing strategies are tailored to different model structures, including decision-boundary probing for classification models, distributional sampling for diffusion models, and response-based probing for LLMs. Our intuition is that a model’s behavior on specific inputs reflects its internal knowledge, enabling an arithmetic way to measure the consistency of knowledge evolution with fine-tuning trajectory. In summary, we first explicitly parameterize the knowledge modifications introduced during fine-tuning. Building on this, we propose an effective knowledge vectorization mechanism to embed the edited knowledge into a shared latent space, that offers a principled foundation for model lineage attestation, where the consistency between the fine-tuning trajectory and the knowledge evolution path forms the necessary condition for validating model lineage relationships. Our main contributions are summarized as follows: • Inspired by the genetic mechanism of human evolution, we uncover for the first time the knowledge evolution mechanism in the model fine-tuning process, grounding the effective model lineage verification in internal representational evidence. • We propose a novel model lineage attestation methodology by exploring consisted knowledge evolution with fine-tuning trajectory. To verify the knowledge consistency, we devise a novel vectorization mechanism to embed the models’ knowledge in a shared

Read the complete text