The Challenge of Identifying the Origin of Black-Box Large Language Models
Ziqing Yang Yixin Wu Yun Shen Wei Dai Michael Backes Yang Zhang · 2025
Read The Challenge of Identifying the Origin of Black-Box Large Language Models by Ziqing Yang Yixin Wu Yun Shen Wei Dai Michael Backes Yang Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04332.txt.
Introduction
Ziqing Yang and five co-authors take up the challenge of identifying the origin of black-box large language models in a 2025 paper. The money at stake in such models makes theft and misuse a live fear. If a stolen model is served behind an API, its owner can only ask it questions, never inspect its weights.
Their method, PlugAE, plants model-specific adversarial embeddings and lets owners set their own copyright tokens on a chosen query set. Tests show it names the source model more truly and more sturdily than watermarking or fingerprinting rivals. Checks of stealth and trust, plus part-by-part trials, back its use in the real world.
Catalog record
| CREATOR | Ziqing Yang Yixin Wu Yun Shen Wei Dai Michael Backes Yang Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04332
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Challenge of Identifying the Origin of Black-Box Large Language Models Ziqing Yang Yixin Wu Yun Shen Wei Dai Michael Backes Yang Zhang Abstract The tremendous commercial potential of large language models (LLMs) has heightened concerns about their unauthorized use. Third parties can customize LLMs through fine-tuning and offer only black-box API access, effectively concealing unauthorized usage and complicating external auditing processes. This practice not only exacerbates unfair competition, but also violates licensing agreements. In response, identifying the origin of black-box LLMs is an intrinsic solution to this issue. In this paper, we first reveal the limitations of state-of-the-art passive and proactive identification methods with experiments on 30 LLMs and two real-world black-box APIs. Then, we propose the proactive technique, PlugAE , which optimizes adversarial token embeddings in a continuous space and proactively plugs them into the LLM for tracing and identification. The experiments show that PlugAE can achieve substantial improvement in identifying fine-tuned derivatives. We further advocate for legal frameworks and regulations to better address the challenges posed by the unauthorized use of LLMs. 1 1 1 We will release our code to facilitate research in the field. Introduction Large language models (LLMs) have become integral parts of a wide range of services owing to their versatile capabilities in various domains. Facing the huge potential of LLMs, black-box LLM services [ 29 , 2 , 9 , 31 ] that provide users only with API access are emerging as well as open-source LLMs [ 36 , 19 , 26 , 12 ] , fostering greater accessibility and transparency in the field. As shown in Table 1 , we thoroughly reviewed the licenses of mainstream LLMs and LLM services from six organizations and observed that most organizations, such as OpenAI and Meta, prohibit third parties from rebranding their LLMs and impose restrictions on their commercial use. Despite these regulations, unofficial channels or unethical practices are dedicated to unauthorized releases of open-source models or leaks of proprietary black-box services [ 14 , 20 ] . These actors may fine-tune these LLMs for specific tasks and provide black-box services without properly branding their model (see Figure 1 ). This violates the licensing agreements, exacerbates unfair competition, stifles innovation, and creates barriers to collaboration. Figure 1 : A black-box LLM identification scenario. Identifying the origin of black-box LLMs is an intrinsic solution to the problem. In this work, we focus on the task of identifying the origin of a black-box LLM that might have been further fine-tuned on specific datasets. Specifically, given a base LLM, we aim to identify whether the black-box suspect models are its derivatives. We collect four LLMs as base models, and 30 LLMs and two LLM API services as suspect models for experiments. Existing identification methods can be categorized into two classes, i.e., passive and proactive , depending on whether the base LLM is proactively modified before release (see Figure 2 in the Appendix). Specifically, passive identification refers to methods that make identification without knowing whether the base model is modified or not [ 7 , 43 , 25 , 14 , 20 ] . Passive methods perform identification by querying with optimized text input, e.g., adversarial text, without making any changes to the model [ 14 , 20 ] . Proactive methods modify the base models and identify the origins of suspect models based on the modifications [ 13 , 22 , 40 , 39 ] . Table 1 : Usage scenarios by each organization’s model/API licenses. “-” denotes not applicable . Usage Scenario Organization OpenAI [ 32 ] Anthropic [ 3 ] Google [ 11 ] Mistral AI [ 28 ] Meta [ 27 ] Ai2 [ 1 ] Open-Source Model 1 ✗ ✗ ✓ ✓ ✓ ✓ Query-Only API Service ✓ ✓ ✓ ✓ ✗ ✗ Fine-Tuning API Service ✓ ✓ ✓ ✓ ✗ ✗ Commercial Use ✗ ✗ - ✗ ✓ ✗ Commercial Use (Special Permission) ✓ - ✓ ✓ ✓ ✓ Rebranding ✗ ✗ ✗ ✗ ✗ ✗ 2 1 The open-source models include licenses not yet approved by the Open Source Initiative ( https://opensource.org/license ). 2 Note that Ai2’s OLMo series is under Apache 2.0 license [ 4 ] and allows rebranding, while there are other LLMs, such as tulu-2 series, are under the AI2 ImpACT License for Low Risk Artifacts ( https://huggingface.co/allenai/tulu-2-7b/blob/main/LICENSE.md ), which forbids rebranding. Figure 2 : Passive and proactive methods to identify the origin of black-box LLMs. We first theoretically analyze the limitations of existing AE-based passive identification methods [ 14 , 20 ] by formalizing them under a unified loss function. This framework reveals their dependence on discrete optimization, which impedes optimal solutions. We also observe that most existing proactive identification methods [ 13 , 22 , 40 , 39 , 6 ] fine-tune the LLM in a backdooring manner. This approach inevitably alters the model, disrupting its utility, and is computationally expensive. Moreover, it is prone to mitigation when the modified LLM undergoes further customization. To overcome these challenges and better identify fine-tuned derivatives, we propose PlugAE , which proactively modifies the base LLM by plug ging in the a dversarial token e mbeddings into the model without altering the model’s weights. Specifically, given a base model, PlugAE first optimizes a sequence of token embeddings as an adversarial example for a pre-defined query set, such as a set of question-answer pairs. PlugAE allows the model owner to define custom copyright tokens, each corresponding to an adversarial token embedding. Then, PlugAE plugs these token-embedding pairs into the LLM by adding the copyright tokens to the tokenizer’s vocabulary and injecting the token-embedding pairs into the model’s embedding layer. This process avoids modifying the model’s weights, ensuring that the model’s utility is preserved when the input does not include copyright tokens. We can later identify the suspect model by querying the suspect model with the query set and copyright tokens. We also provide theoretical evidence that PlugAE achieves performance closer to the optimal solution compared to existing AE-based methods. We further validate the theoretical findings by conducting extensive experiments on three base models and 32 suspect models, proving the effectiveness of PlugAE in practice. Contributions. Overall, this study aims to ignite a crucial discussion on enhancing model transparency and accountability in an era defined by complex, often opaque, AI-driven interactions. Our contributions are as follows: • We summarize the licenses and agreements of current open-source LLMs and API services and raise the challenge of LLM identification. • We evaluate both passive and proactive methods on the task of black-box LLM identification on various LLMs and show their unreliability on fine-tuned derivatives. • We propose PlugAE , which proactively modifies the LLM by plugging the adversarial token embeddings into the model. We theoretically and empirically show its effectiveness and robustness in identifying fine-tuned derivatives. Related Work Existing black-box LLM identification methods can be categorized into two classes, i.e., passive and proactive identification, based on whether they require modifying the LLM proactively before distribution. We summarize the differences between the two types in Table 2 . Table 2 : Different types of identification methods. “-” denotes not applicable . Note that “Modification?” denotes whether we will modify the model file, while “Change