The Grand Software Supply Chain of AI Systems

Carmine Cesarano, Martin Monperrus · 2026

Read The Grand Software Supply Chain of AI Systems by Carmine Cesarano, Martin Monperrus (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27781.txt.

Introduction

Cesarano and Monperrus treat the AI supply chain as a first-class study object across four layers: data, training, use, and a cross-cutting substrate. Across those layers they spot four built-in gaps that older tools miss: proof, versions, watching, and tracking. Current systems fall short on all four: hidden links, no rollback to known builds, silent decay, and lineage hard to trace. Counting a sample stack of 48 live open-source projects, they count 4,664 direct links growing to 11,508 knock-on units and roughly 392 million lines of code.

Catalog record

CREATORCarmine Cesarano, Martin Monperrus
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60371
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27781

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Grand Software Supply Chain of AI Systems Carmine Cesarano, Martin Monperrus Abstract AI systems rest on software with low integrity mechanisms, leaving AI systems exposed across every stage from data acquisition to final inference. This paper makes the AI supply chain a first-class object of analysis, decomposing it across four architectural layers: data acquisition, model training, model inference, and a cross-cutting substrate. Within these layers, we identify four structural gaps that traditional supply chain mechanisms do not address: verifiability, versioning, observability, and traceability. Current AI systems fall short on all of them: they carry undeclared behavioral couplings that no resolver enforces; they cannot be reverted back to known working assemblies; they degrade silently rather than surfacing breaking changes; and their lineage can hardly be approximated. To illustrate the scale of the software supply chain of AI, we measure a reference stack of 48 production-grade open-source projects, which declares 4,664 direct dependencies, resolves to 11,508 transitive packages, and totals roughly 392M lines of code. 1 Introduction The integrity mechanisms that secure traditional software, including reproducible builds, semantic versioning, signed attestations, do not transfer to AI systems, yet no framework exists to characterize what AI’s supply chain even encompasses. The consequences are already visible: in recent years, outages and security incidents have accumulated across every layer of the AI stack. In February 2024, researchers disclosed that roughly one hundred models hosted on Hugging Face, the de facto distribution hub for open-weight AI, carried malicious payloads that execute arbitrary code on any machine that loaded them 5 . Two months earlier, the Stanford Internet Observatory had identified 1,008 instances of child sexual abuse material inside LAION-5B, a five-billion-sample dataset underlying Stable Diffusion and a long tail of derived image generators whose full extent nobody could enumerate 23 . Early in 2026, a compromised dependency in LiteLLM’s CI/CD pipeline allowed attackers to publish a backdoored release that exfiltrated cloud credentials, SSH keys, and Kubernetes secrets 18 . And throughout this period, operators of applications built on frontier model APIs have reported concerning behavioral changes: on one widely cited benchmark, GPT-4’s accuracy at identifying prime numbers fell from 84% to 51% over three months, with no version selector to roll back to and no publicly available changelog 3 . These incidents are not four unrelated failures. They are four symptoms of the same underlying condition: the software supply chain of modern AI systems is large, heterogeneous, and not managed. A single production inference call results from the execution of data acquisition pipelines, training orchestration frameworks, model registries, prompt templates, guardrail filters, quantization toolchains, and serving stacks, each a distinct software project with its own dependency tree. This paper argues for making the software supply chain of AI systems a first-class object of analysis. We decompose the AI software supply chain into four architectural layers (data acquisition, model training, model inference, and cross-cutting substrate) and three abstractions (artifacts, transformations, and infrastructure). To make the scale of the problem concrete, we define and measure a reference AI stack of 48 typical open-source projects whose production use is independently documented. The reference AI stack declares 4,664 direct dependencies and resolves to 11,508 transitive packages, totaling roughly 392M lines of code. This is the scale of the AI software supply chain. Next, we identify four structural gaps that the current supply chain fails to close. The Verifiability property fails today because trained artifacts cannot be reproduced bit-for-bit, so hash verification reveals nothing about whether a checkpoint was produced by the procedure its attestation describes. The Versioning property fails because compound AI systems carry undeclared behavioral couplings (adapter-to-base, index-to-embedder, prompt-to-output-format) that no resolver tracks and enforces, thus first-party API providers can rewrite the served artifact unilaterally. The Observability property fails because AI systems degrade silently rather than crashing, and current telemetry, focused on latency and error rates, fails to attribute a behavioral shift to its root cause. The Traceability property fails because lineage graphs in AI are multi-parent, non-deterministic, and cross-organizational, none of which existing attestation frameworks (SLSA, in-toto) are able to represent. These four gaps define the research agenda this paper addresses. To sum up, our contributions are: • the first-ever characterization of the AI software supply chain, which demonstrates its scale, depth and complexity; • the definition of four essential integrity properties that current AI systems fail to meet, defining a coherent research agenda; • an empirical measurement of a 48-project reference AI stack resolving to 11,508 transitive packages and roughly 392M lines of code, concretely establishing the scale of the problem, with an associated web-based visualization at https://assert-kth.github.io/ai-supply-chain/ . The remainder of the paper is organized as follows. Section 2 introduces the layer-and-abstraction framework. Sections 3 – 6 examine each architectural layer. Section 7 formalizes the four gaps. Section 8 reports the empirical measurement of the reference stack. Section 9 analyzes related work. Section 10 concludes the paper. 2 The Software Supply Chain of AI Systems Modern AI systems combine myriad software components. Those components are produced independently by multiple providers and integrated on shared infrastructure 27 . We call the collection of these components the software supply chain of AI. Definition 1 The software supply chain of an AI system is the collection of software components that produce, transform, store, and serve the artifacts of that system, from the initial training data collection to the final inference run in production. We decompose this software supply chain into four architectural layers , each addressing a distinct concern in the construction and operation of a compound AI system. Three layers correspond to the principal concerns through which an AI system comes into being and is delivered: data acquisition (Section 3 ) comprises the software that collects and curates datasets; model training (Section 4 ) comprises the software that derives model checkpoints from datasets; model integration and inference (Section 5 ) comprises the software that composes checkpoints with prompts, retrieval pipelines, tools, and guardrails into deployable systems that serve end users. The fourth layer, cross-cutting infrastructure (Section 6 ), is not a stage-specific concern but a shared software substrate whose components appear as dependencies within the other layers. The three stage layers are not traversed linearly: deployed systems emit observations that feed back into data curation, and new data or newly observed failure modes trigger additional rounds of training, so components circulate continuously across layers. We describe this software supply chain through three complementary abstractions that characterize what its software does , what it handles , and what it runs on . Transformations are the processes the software performs, the code that derives new artifacts from existing ones. Artifacts are the persistent objects this software produces, consumes, and exchanges, with model weights the most notable among them. Infrastructure is the computational substrate, itself composed of software, on which transformations execute. Figure 1: The software supply chain of a reference stack of 48 open-source projects , combined in an end-to-end AI system. Nodes are software projects; an edge A\rightarrow B indicates that project A uses project B . This reference stack totals \approx 392\,\text{M LOC} (see Section 8 ) . Definition 2 An AI artifact is any persistent object produced, consumed, or manipulated software components in the supply chain;

Read the complete text