Invisible Traces: Using Hybrid Fingerprinting to identify underlying LLMs in GenAI Apps

2025

Read Invisible Traces: Using Hybrid Fingerprinting to identify underlying LLMs in GenAI Apps (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18712.txt.

Introduction

Devansh Bhardwaj and Naman Mishra fingerprint the hidden models inside AI apps in a 2025 paper. Many apps wrap a large language model, but which one stays secret. Knowing matters for security and transparency. Older fingerprinting needs direct chats with the app, and fails when apps chain several agents, swap models often, or hide their internals.

Their framework blends two probes. Static checks read architectural features; dynamic checks read behavioral traits under queries. Together they identify the underlying model even in shifting, multi-agent settings. The paper also names threat scenarios where classic methods go blind. An evaluation setup mimics real deployment conditions to test the approach. The authors report their method stays accurate and robust across those settings. They frame hybrid fingerprinting as practical oversight for generative AI products.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18712

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Invisible Traces: Using Hybrid Fingerprinting to identify underlying LLMs in GenAI Apps Abstract Fingerprinting refers to the process of identifying underlying Machine Learning (ML) models of AI Systemts, such as Large Language Models (LLMs), by analyzing their unique characteristics or patterns, much like a human fingerprint. The fingerprinting of Large Language Models (LLMs) has become essential for ensuring the security and transparency of AI-integrated applications. While existing methods primarily rely on access to direct interactions with the application to infer model identity, they often fail in real-world scenarios involving multi-agent systems, frequent model updates, and restricted access to model internals. In this paper, we introduce a novel fingerprinting framework designed to address these challenges by integrating static and dynamic fingerprinting techniques. Our approach identifies architectural features and behavioral traits, enabling accurate and robust fingerprinting of LLMs in dynamic environments. We also highlight new threat scenarios where traditional fingerprinting methods are ineffective, bridging the gap between theoretical techniques and practical application. To validate our framework, we present an extensive evaluation setup that simulates real-world conditions and demonstrate the effectiveness of our methods in identifying and monitoring LLMs in Gen-AI applications. Our results highlight the framework’s adaptability to diverse and evolving deployment contexts. Devansh Bhardwaj 1 , Naman Mishra 2 1 Indian Institute of Technology Roorkee 2 Repello AI 1 Introduction The fingerprinting of Large Language Models (LLMs) has emerged as a critical area of research, playing an important role in ensuring AI security and transparency ( Pasquini et al., 2024 ) , ( Yang & Wu, 2024 ) , ( Zhang et al., 2024 ) , ( Yamabe et al., 2024 ) . As LLMs become deeply embedded in a variety of applications, their widespread adoption brings forth significant vulnerabilities ( Chao et al., 2023 ) , ( Anil et al., 2024 ) , ( Carlini et al., 2024 ) , ( Liu et al., 2023a ) , ( Liu et al., 2023b ) , ( Russinovich & Salem, 2024 ) , ( Xu et al., 2024 ) . Identifying and monitoring the specific models underlying these systems is a crucial step in mitigating these risks. However, existing fingerprinting methods, which predominantly rely on direct interaction and crafted queries to infer model identity or behavior ( Pasquini et al., 2024 ) , have some limitations. While effective in controlled environments, these approaches struggle to address the complexities of real-world deployments. In this paper, we categorize current LLM fingerprinting into two primary paradigms: Static Fingerprinting and Dynamic Fingerprinting . We provide an in-depth analysis of each paradigm, exploring their individual strengths and limitations. We propose a novel combined pipeline that integrates the complementary strengths of static and dynamic fingerprinting. This pipeline enhances the robustness and accuracy of model identification in complex, real-world scenarios. Our experimental results demonstrate that this combined approach significantly outperforms individual methods, establishing it as a reliable solution for LLM fingerprinting. We also share a unique insight through our dynamic fingerprinting model: in our experiments, we discovered that by simply observing the outputs of LLMs on generic prompts, it is possible to determine the underlying LLM. In other words, we demonstrate that different LLM model families produce semantically distinct types of outputs. This aligns with the findings of existing works which show the different lexical features being generated by different model families. ( McGovern et al., 2024 ) Our contributions can be summarized as follows: 1. We provide an in-depth analysis of LLM fingerprinting, focusing on real-world use cases. Dividing the LLM fingerprinting into two new paradigms. 2. We present a hybrid pipeline that effectively integrates static and dynamic fingerprinting techniques, offering improved adaptability to real-world constraints. 3. We share a novel finding from our experiments that demonstrates how observing the outputs of LLMs on generic prompts can reliably reveal the underlying model. The remainder of this paper is organized as follows: We begin by discussing real-world scenarios where traditional fingerprinting methods fail, highlighting the challenges these scenarios pose. Next, we formally define the two paradigms of fingerprinting and delve into the technical details of our proposed combined pipeline. Finally, we present our evaluation setup and experimental results, followed by a discussion of related works to contextualize our contributions within the broader LLM fingerprinting landscape. Figure 1: Pipeline for Combined Fingerprinting Framework. The framework integrates static and dynamic fingerprinting approaches to identify underlying Large Language Models (LLMs). (I) Static Fingerprinting using LLMMap actively probes the target application with strategic queries, generating query-response pairs that are analyzed by a classifier to produce a model distribution. (II) Manual Fingerprinting employs an iterative probing process, guided by a judge model, to refine outputs and improve identification accuracy. (III) Dynamic Fingerprinting passively observes generic model responses and leverages a dynamic classifier to infer the model distribution. The outputs from static and dynamic fingerprinting are combined using a weighted sum to robustly determine the underlying model. 2 Background The fingerprinting of Large Language Models (LLMs) has become increasingly significant in the domain of AI security and transparency ( Pasquini et al., 2024 ) , ( Yang & Wu, 2024 ) , ( Zhang et al., 2024 ) , ( Yamabe et al., 2024 ) . Determining the underlying model is a crucial part of supply chain security tests for third-party applications and vendor evaluations for companies. Enterprises that have set roles and policies for different AI models need real-time fingerprinting on logs of AI applications being used internally to enforce appropriate rules and guardrails. In addition to this, fingerprinting to determine the underlying LLM is one of the first steps in red-teaming evaluations of AI Applications as it can help craft further attacks. Currently, in practice, fingerprinting is mostly done through manual or automated prompting techniques to leak the model name from the application ( Pasquini et al., 2024 ) , ( Yang & Wu, 2024 ) . However, this can be inaccurate as the applications may give a hallucinated response about their internal architecture, and it is impossible to verify this under a black-box setting (where there is no information on or access to internal components of the AI application). We explore real-world cases and the challenges they pose for fingerprinting below. 2.1 Real World Application Landscape In practical deployments, LLMs operate within complex environments that diverge markedly from controlled experimental conditions. The following factors contribute to the intricacies of real-world fingerprinting: 2.1.1 Concurrent Utilization of Multiple Models Contemporary platforms are adopting dynamic model routing, distributing requests across various LLMs depending on factors such as response time, cost efficiency, and task complexity. For instance, a customer support chatbot might direct straightforward inquiries to a smaller, faster model like GPT-3.5 Turbo while assigning more intricate reasoning tasks to a larger model like GPT-4. This variability in model selection makes it challenging to establish consistent fingerprinting patterns. Furthermore, model chaining—where one LLM’s output feeds into another—produces hybrid responses that merge characteristics from multiple models, further complicating fingerprinting efforts. 2.1.2 Collaborative Multi-Agent Systems In platforms like AutoGPT ( Yang et al., 2023 ) or Microsoft’s TaskWeaver ( Bo Qiao, 2023 ) , large language models operate in tandem with specialized agents (e.g., code executors, data retrieval services). For example, one agent might modify an LLM’s output

Read the complete text